-- Logs begin at Tue 2022-08-23 21:14:41 UTC, end at Tue 2022-08-23 22:33:52 UTC. -- Aug 23 22:06:10.497208 dv-osbrick-852824-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 22:06:10.506057 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 22:06:10.508212 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 22:06:10 2022] *** Aug 23 22:06:10.508212 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 22:06:10.508212 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 22:06:10.508212 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: nodename: dv-osbrick-852824-3-ceph Aug 23 22:06:10.508212 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: machine: x86_64 Aug 23 22:06:10.508212 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: clock source: unix Aug 23 22:06:10.508212 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: pcre jit disabled Aug 23 22:06:10.508212 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: detected number of CPU cores: 4 Aug 23 22:06:10.508212 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: current working directory: / Aug 23 22:06:10.508212 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: detected binary path: /usr/bin/uwsgi-core Aug 23 22:06:10.508749 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: your processes number limit is 47680 Aug 23 22:06:10.508749 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: your memory page size is 4096 bytes Aug 23 22:06:10.508749 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: detected max file descriptor number: 2048 Aug 23 22:06:10.508749 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: lock engine: pthread robust mutexes Aug 23 22:06:10.508749 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: thunder lock: enabled Aug 23 22:06:10.508749 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 22:06:10.508749 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 22:06:10.552639 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: Python main interpreter initialized at 0x5578332249c0 Aug 23 22:06:10.552639 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: python threads support enabled Aug 23 22:06:10.552639 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: your server socket listen backlog is limited to 100 connections Aug 23 22:06:10.552639 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: your mercy for graceful operations on workers is 90 seconds Aug 23 22:06:10.552979 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 22:06:10.553053 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: *** Operational MODE: preforking *** Aug 23 22:06:10.553301 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: *** uWSGI is running in multiple interpreter mode *** Aug 23 22:06:10.553301 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: spawned uWSGI master process (pid: 88392) Aug 23 22:06:10.553494 dv-osbrick-852824-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 23 22:06:10.559879 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: spawned uWSGI worker 1 (pid: 88404, cores: 1) Aug 23 22:06:10.559879 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: spawned uWSGI worker 2 (pid: 88405, cores: 1) Aug 23 22:06:10.559879 dv-osbrick-852824-3-ceph devstack@keystone.service[88392]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 22:06:15.229227 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:06:15.229227 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: from cryptography.utils import int_from_bytes Aug 23 22:06:15.230043 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:06:15.230043 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: from cryptography.utils import int_from_bytes Aug 23 22:06:15.232245 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:06:15.232245 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: from cryptography.utils import int_from_bytes Aug 23 22:06:15.232688 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 22:06:15.232688 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: from cryptography.utils import int_from_bytes Aug 23 22:06:15.281643 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:06:15.281827 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:06:15.282020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] command line args: [] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:06:15.282297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:06:15.282479 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ================================================================================ {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:06:15.282734 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 22:06:15.282829 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] admin_token = **** {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.282936 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 22:06:15.283067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] config_dir = [] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.283160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] command line args: [] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 22:06:15.283235 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.283311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] config_source = [] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.283386 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 22:06:15.283495 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] debug = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.283584 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ================================================================================ {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 22:06:15.283695 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.283982 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] admin_token = **** {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.284046 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] config_dir = [] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.284101 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.284235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.284312 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.284405 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] config_source = [] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.284480 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.284582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] debug = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.284739 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.284829 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.284976 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] list_limit = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.285059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.285161 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.285231 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] log_config_append = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.285340 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.285416 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.285514 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] log_dir = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.285637 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.285720 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] log_file = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.285868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] list_limit = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.285953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.286066 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] log_config_append = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.286149 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.286213 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.286379 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] log_dir = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.286456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.286611 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] log_file = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.286737 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.286821 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.286895 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.286975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.287061 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.287189 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.287292 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.287599 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.287731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.287731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.288002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.288144 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.288352 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.288665 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.288779 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.288921 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.289036 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.289177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.289292 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.289404 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.289544 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.289656 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.289797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.289912 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.289912 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.290117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.290251 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.290374 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] publish_errors = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.290480 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.290585 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.290585 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.290816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.290932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.291044 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] publish_errors = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.291158 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.291262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.291343 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.291419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.291543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] standard_threads = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.291616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.291693 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.291768 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.291883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.291959 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.292028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.292097 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] standard_threads = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.292258 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] use_journal = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.292344 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.292490 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] use_json = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.292691 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.292814 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] use_stderr = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.292814 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] use_syslog = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.293043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.293167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.293284 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] use_journal = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.293398 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.293511 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] use_json = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.293636 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.293763 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] use_stderr = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.293884 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.294027 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] use_syslog = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.294144 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.294258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 22:06:15.294372 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.294494 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.294610 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.294730 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.294845 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.294957 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.295060 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.295164 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.295268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.295365 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.295461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.295556 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.295651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.295754 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.295872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.295975 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.296071 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.296220 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.296352 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.296478 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.296624 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.296740 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.296854 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.296968 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.297081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.297204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.297326 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.297447 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.297561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.297674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.297787 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.297974 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.297974 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.298199 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.298312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.298425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.298538 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.298646 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.298766 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.298882 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.299001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.299135 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.299261 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.299377 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.299732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.299889 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.300008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.300121 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.300246 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.300363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.300476 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.300590 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.300703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.300816 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.300945 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.301061 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.301174 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.301286 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.301403 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.301523 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.301649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.301798 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.301917 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.302031 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.302143 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.302261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.302384 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.302498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.302612 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.302725 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.302844 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.302958 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.303078 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.303192 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.303305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.303418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.303539 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.303654 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.303857 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.303978 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.304092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.304205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.304318 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.304430 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.304554 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.304670 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.304790 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.304904 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.305017 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.305129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.305250 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.305365 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.305479 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.305479 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.305690 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.305803 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.305926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.306040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.306154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.306302 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.306420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.306534 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.306658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.306773 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.306893 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.307007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.307126 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.307269 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.307393 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.307515 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.307635 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.307750 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.308431 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.308568 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.308687 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.308808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.308930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.309047 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.309160 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.309283 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.309408 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.309532 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.309650 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.309650 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.309875 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.309998 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.309998 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.310232 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.310232 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.310449 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.310563 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.310677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.310791 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.310913 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.311030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.311145 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.311265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.311380 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.311495 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.311620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.311743 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.311897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.312038 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.312154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.312269 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.312394 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.312511 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.312624 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.312738 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.312852 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.312966 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.313088 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.313205 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.313319 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.313432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.313546 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.313659 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.313781 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.313905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.314020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.314140 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.314262 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.314377 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.314499 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.314615 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.314729 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.314883 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.315006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.315121 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.315244 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.315362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.315484 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.315599 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.315713 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.315839 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.316025 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.316143 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.316257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.316409 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.316527 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.316647 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.316771 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.316896 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.317024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.317146 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.317261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.317383 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.317498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.317621 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.317737 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.317852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.317852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.318075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.318196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.318319 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.318436 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.318549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.318662 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.318786 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.318902 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.319023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.319138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.319252 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] auth.external = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.319373 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.319489 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.319602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.319724 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.319899 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] auth.external = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.320018 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.320163 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.320289 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] auth.password = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.320406 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.320529 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] auth.token = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.320645 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.320768 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.320885 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] auth.password = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.320999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.321114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] auth.token = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.321229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.321343 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.321466 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.321583 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.321698 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.321819 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.321935 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.322049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.322172 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.322289 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.322404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] credential.caching = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.322519 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.322640 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.322755 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.322755 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] credential.caching = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.322980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.323095 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.323209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.323324 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.323453 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.324199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.324318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.324433 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.324548 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.324663 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.324779 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.324903 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.325020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.325020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.325237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.325353 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.325468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.325592 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.325592 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.325809 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.325924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.326038 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.326153 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.326275 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.326392 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.326541 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.326657 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] federation.caching = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.326771 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.326887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.327010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.327127 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.327249 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.327364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.327479 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] federation.caching = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.327594 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.327718 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.327870 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.327989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.328105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.328220 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.328335 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.328462 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.328579 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.328695 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.328817 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.328933 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.329057 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.329174 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.329289 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.329405 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.329519 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.caching = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.329634 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.329758 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.329875 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.329991 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.330106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.330220 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.330319 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.caching = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.330489 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.330608 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.330724 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.330839 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.330954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.331078 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.331206 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.331323 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.331438 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.331553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.331553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.331767 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.331919 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.332039 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.332156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.332271 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.332271 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.332494 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.332494 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.332720 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.332835 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.332950 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.333065 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.333181 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.333303 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.333420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.333536 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.333651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.333766 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.333880 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.334003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.334124 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.334240 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.334355 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.334470 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.334585 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.334708 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.334824 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.334939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.335054 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.335169 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.335285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.335408 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.335525 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.335641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.335756 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.335885 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.336003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.336136 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.336255 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.336371 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.336485 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.336641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.336757 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.336881 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.337004 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.337120 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.337235 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.337360 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.337476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.337599 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.337722 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.337839 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.337953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.338068 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.338189 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.338313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.338431 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.338553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.338669 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.338783 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.338898 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.339025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.339156 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.339273 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.339495 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.339616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.339744 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.339935 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.340055 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.340171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.340286 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.340401 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.340526 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.340643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.340758 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.340758 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.340974 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.341088 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.341211 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.341328 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.341443 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.341559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.341673 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.341788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.341910 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.342027 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.342142 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.342256 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.342372 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.342486 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.342610 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.342733 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.342849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.342964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.343079 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.343193 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.343320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.343437 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.343551 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.343667 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.343781 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.343912 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.344032 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.344150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.344265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.344380 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.344495 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.344609 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.344732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.344850 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.344966 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.344966 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.345180 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.345295 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.345417 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.345534 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.345649 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.345765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.345879 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.345993 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.346116 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.346232 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.346632 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.346752 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.346874 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.346991 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.347114 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.347231 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.347346 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.347467 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.347583 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.347698 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.347822 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.347961 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.348076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.348190 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.348304 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.348418 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.348545 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.348662 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.348776 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.348892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.349006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.349120 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.349120 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.349345 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.349460 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.349573 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.349687 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.349801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.349925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.350041 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.350155 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.350269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.350383 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.350497 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.350619 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.350735 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.350849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.350964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] resource.caching = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.351079 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.351194 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.351316 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] resource.caching = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.351432 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.351546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.351661 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.351775 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.351955 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.352084 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.352201 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.352316 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.352430 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.352543 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.352657 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.352780 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.352896 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.353010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.353125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.353239 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.353353 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] role.caching = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.353539 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.353657 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] role.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.353771 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] role.caching = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.353885 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.354007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] role.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.354128 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.354251 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.354367 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.354497 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.354653 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.354771 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.354896 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.355013 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.355129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.355244 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.355360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.355474 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.355597 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.355714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.355847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.355965 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.356081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.356196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.356322 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.356322 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.356540 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.356693 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.356813 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.356927 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.357050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.357050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.357269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.357384 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.357498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.357498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.357721 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.357838 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.357953 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.358067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.358181 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.358297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.358420 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.358536 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.358651 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.358765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.358879 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.358879 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.359104 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.359218 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.359333 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.359333 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.359547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.359670 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.359787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.359930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.360046 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.360046 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.360261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.360389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.360506 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.360621 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.360736 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.360851 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.360965 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.361088 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.361204 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.361318 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.361434 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.361548 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.361662 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] token.caching = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.361785 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.361902 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.362017 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] token.caching = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.362131 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.362246 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.362360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.362471 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.362572 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.362686 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.362801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.362917 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.363031 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.363154 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.363269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.363383 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.363498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.363613 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.363728 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.363873 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.363993 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.364113 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.364229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.364344 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.364458 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.364582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.364582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.364799 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.364914 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.365029 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.365029 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.365253 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.365253 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.365469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.365584 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.365699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.365814 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.365940 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.connection = **** {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.366065 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.connection = **** {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.366194 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.366322 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.366429 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.366543 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.366659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.366806 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.366924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.367048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.367165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.367323 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.367441 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.367557 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.367671 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.367796 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.367966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.368083 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.368198 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.368314 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.368429 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.368556 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.368701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.368820 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.368936 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.369051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.369165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.369311 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.369429 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.369544 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.369659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.369775 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.369891 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.370014 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.370131 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.370253 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.370869 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.370988 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 22:06:15.371104 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:06:15.371230 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 22:06:15.399704 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.399932 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.400020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.400167 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.400269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.400424 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.408581 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.408979 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.438392 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.438635 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.439106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.439338 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.491539 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.492132 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.540650 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.540883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.541201 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.541436 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.609905 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.610138 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.610372 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.610599 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.610681 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.610819 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.610900 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.611036 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.611119 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.611304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.611520 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.611732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.635269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.635393 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.635533 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.635624 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.635727 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.635848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.636036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.636154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.636291 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.636402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.636504 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.636681 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.636767 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.637071 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.647578 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.647671 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.661000 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.661235 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.661460 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.661679 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.661894 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.662108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.662370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88405) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.662931 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.663164 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.663391 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.663615 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.663857 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.664075 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.664290 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88404) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 22:06:15.679894 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.680088 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.680214 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:06:15.680297 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:06:15.680444 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.680653 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:06:15.680831 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.680923 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.681181 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.681264 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 22:06:15.681446 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.681631 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.681710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.682080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.682548 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.683508 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.693459 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.693934 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.694403 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.694773 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.696713 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.697000 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.697274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.697554 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.702590 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.705477 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.706696 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.706998 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.707289 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.707577 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.707968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.708269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.708398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.708634 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.708728 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.708952 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.709038 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.709231 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.709312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.709522 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.709616 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.709786 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.709866 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.710056 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.710326 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.710595 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.710866 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.711132 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.737242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.737447 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.738720 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.738906 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.739018 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.739192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.743578 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.743668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.743824 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.743930 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.744134 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.744217 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.751244 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.751536 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.751692 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.752010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.755608 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.755927 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.756011 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.756218 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.756303 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.756508 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.756591 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.756800 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.756893 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.757095 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.757202 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.757483 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.757566 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.757766 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.757849 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.758037 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.773303 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.773600 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.773742 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.774020 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.777554 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.778285 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.780626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.780929 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.781372 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.781667 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.785205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.785948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.788285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.789139 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.791348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.791655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.791965 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.792702 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.792807 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.793117 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.793200 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.793573 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.793655 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.793880 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.794164 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.794547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.809656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.809939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.810216 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.810476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.811341 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.811820 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.812310 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.812664 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.817516 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.819171 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.819448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.821265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.822072 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.822357 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.822653 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.822922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.823016 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.823201 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.823284 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.826233 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.826524 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.826945 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.827314 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.827598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.834423 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.834707 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.834986 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.835262 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.835543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.835847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.836125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.840338 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.840628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.840912 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.841195 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.841476 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.841752 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.842370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.852261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.855783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.858769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.859633 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.860550 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.862512 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.862605 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.862795 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.863076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.865514 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.866953 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.868534 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.868817 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.869098 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.869438 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.870907 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.873930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.874217 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.874573 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.874858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.875756 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.877253 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.880098 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.880393 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.880679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.880971 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.885348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.885645 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.886070 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.890877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.891168 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.891447 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.892659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88405) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.893057 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.893343 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.893641 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.893915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.894187 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.894460 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.894736 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.895012 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.895286 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.895555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.895815 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.896106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.896365 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88405) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.898157 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88404) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 22:06:15.898541 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.898825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.899124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.899400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.899674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.900046 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.900327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.900607 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.900875 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.901145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.901416 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.902251 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.902734 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88404) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 22:06:15.931749 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5578332249c0 pid: 88405 (default app) Aug 23 22:06:15.935673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f375a-7089-4588-8824-31dd923c91a7 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:15.935987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f375a-7089-4588-8824-31dd923c91a7 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:15.936264 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f375a-7089-4588-8824-31dd923c91a7 None None] PATH_INFO: `/v3` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:15.938350 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5578332249c0 pid: 88404 (default app) Aug 23 22:06:15.940722 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Tue Aug 23 22:06:15 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:23.118852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd655f7-5633-47b5-8b6a-597ad56b4f40 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:23.119366 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd655f7-5633-47b5-8b6a-597ad56b4f40 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:23.119473 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd655f7-5633-47b5-8b6a-597ad56b4f40 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:23.126756 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:23 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:06:23.133034 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4a3a-cfdc-4dad-babe-1100c1dfec33 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:23.133457 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4a3a-cfdc-4dad-babe-1100c1dfec33 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:23.133583 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4a3a-cfdc-4dad-babe-1100c1dfec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:23.210647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: INFO dbcounter [None req-f60e4a3a-cfdc-4dad-babe-1100c1dfec33 None None] Registered counter for database keystone Aug 23 22:06:23.230739 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG oslo_db.sqlalchemy.engines [None req-f60e4a3a-cfdc-4dad-babe-1100c1dfec33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:06:23.237188 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writer thread running {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:06:23.415169 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG passlib.handlers.bcrypt [None req-f60e4a3a-cfdc-4dad-babe-1100c1dfec33 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88405) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 22:06:23.415505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG passlib.handlers.bcrypt [None req-f60e4a3a-cfdc-4dad-babe-1100c1dfec33 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88405) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 22:06:23.470205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-f60e4a3a-cfdc-4dad-babe-1100c1dfec33 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:23.472118 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-f60e4a3a-cfdc-4dad-babe-1100c1dfec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:23.601802 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 22:06:24.142475 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd655f7-5633-47b5-8b6a-597ad56b4f40 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:24.219470 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: INFO dbcounter [None req-8fd655f7-5633-47b5-8b6a-597ad56b4f40 None None] Registered counter for database keystone Aug 23 22:06:24.241476 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG oslo_db.sqlalchemy.engines [None req-8fd655f7-5633-47b5-8b6a-597ad56b4f40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88404) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 22:06:24.248262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writer thread running {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 22:06:24.370615 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd655f7-5633-47b5-8b6a-597ad56b4f40 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:24.375186 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525ea7f-fd38-4a28-ac28-2666683cd4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:24.375818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ea7f-fd38-4a28-ac28-2666683cd4ef admin admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:24.376162 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ea7f-fd38-4a28-ac28-2666683cd4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:24.376470 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525ea7f-fd38-4a28-ac28-2666683cd4ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:24.384625 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525ea7f-fd38-4a28-ac28-2666683cd4ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:24.436643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5525ea7f-fd38-4a28-ac28-2666683cd4ef admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 22:06:24.436981 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525ea7f-fd38-4a28-ac28-2666683cd4ef admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:24.446865 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Aug 23 22:06:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 22:06:24.453729 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e4a3a-cfdc-4dad-babe-1100c1dfec33 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:24.470444 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e4a3a-cfdc-4dad-babe-1100c1dfec33 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:24.475101 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c6bbe-35c0-47f7-b4d7-c4d2abeb7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:24.476237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c6bbe-35c0-47f7-b4d7-c4d2abeb7802 admin admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:24.476521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c6bbe-35c0-47f7-b4d7-c4d2abeb7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:24.476796 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c6bbe-35c0-47f7-b4d7-c4d2abeb7802 admin admin] PATH_INFO: `/v3/projects/8dbd689839d74dba96df18fba25139c2` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:24.478226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c6bbe-35c0-47f7-b4d7-c4d2abeb7802 admin admin] RBAC: Authorizing `identity:get_project(project_id=8dbd689839d74dba96df18fba25139c2)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:24.528898 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0b2c6bbe-35c0-47f7-b4d7-c4d2abeb7802 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 22:06:24.529243 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c6bbe-35c0-47f7-b4d7-c4d2abeb7802 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:24.533887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Tue Aug 23 22:06:24 2022] GET /identity/v3/projects/8dbd689839d74dba96df18fba25139c2 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:26.699367 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a7fdd-40b7-433c-a5da-60521b6a91d2 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:26.699905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a7fdd-40b7-433c-a5da-60521b6a91d2 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:26.700006 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a7fdd-40b7-433c-a5da-60521b6a91d2 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:26.704419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:06:26.709833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894f34f-9d19-46f3-900d-833f60119107 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:26.710225 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894f34f-9d19-46f3-900d-833f60119107 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:26.710384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894f34f-9d19-46f3-900d-833f60119107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:26.731036 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-7894f34f-9d19-46f3-900d-833f60119107 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:26.732577 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-7894f34f-9d19-46f3-900d-833f60119107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:26.740571 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 22:06:27.072932 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a7fdd-40b7-433c-a5da-60521b6a91d2 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:27.085622 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a7fdd-40b7-433c-a5da-60521b6a91d2 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:27.091001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aaae3-243d-4fbc-ae6c-1ef76a1ee405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:27.091599 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aaae3-243d-4fbc-ae6c-1ef76a1ee405 admin admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:27.091923 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aaae3-243d-4fbc-ae6c-1ef76a1ee405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:27.092195 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aaae3-243d-4fbc-ae6c-1ef76a1ee405 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:27.102494 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aaae3-243d-4fbc-ae6c-1ef76a1ee405 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:27.105376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aaae3-243d-4fbc-ae6c-1ef76a1ee405 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:27.115437 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Tue Aug 23 22:06:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 22:06:27.122149 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894f34f-9d19-46f3-900d-833f60119107 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:27.132073 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894f34f-9d19-46f3-900d-833f60119107 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:27.137708 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f301fe-1b0f-4c2d-91fa-95374cea4243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:27.138328 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f301fe-1b0f-4c2d-91fa-95374cea4243 admin admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:27.138607 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f301fe-1b0f-4c2d-91fa-95374cea4243 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:27.138988 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f301fe-1b0f-4c2d-91fa-95374cea4243 admin admin] PATH_INFO: `/v3/users/88d08af5e2704454a689607c83d9c037` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:27.140693 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f301fe-1b0f-4c2d-91fa-95374cea4243 admin admin] RBAC: Authorizing `identity:get_user(user_id=88d08af5e2704454a689607c83d9c037)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:27.142525 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f301fe-1b0f-4c2d-91fa-95374cea4243 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:27.144078 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Tue Aug 23 22:06:27 2022] GET /identity/v3/users/88d08af5e2704454a689607c83d9c037 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:29.417108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2d472-123c-47a1-82a0-eb63e2adcd79 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:29.417624 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2d472-123c-47a1-82a0-eb63e2adcd79 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:29.417841 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2d472-123c-47a1-82a0-eb63e2adcd79 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:29.419159 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:29.424507 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158151e-a68b-4d9a-a16a-7035db36d3e2 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:29.424903 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158151e-a68b-4d9a-a16a-7035db36d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:29.425175 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158151e-a68b-4d9a-a16a-7035db36d3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:29.443430 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-c158151e-a68b-4d9a-a16a-7035db36d3e2 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:29.444644 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-c158151e-a68b-4d9a-a16a-7035db36d3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:29.462150 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3a58b-3ec1-42ba-9bcf-c078fe4619e6 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:29.462439 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3a58b-3ec1-42ba-9bcf-c078fe4619e6 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:29.462721 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3a58b-3ec1-42ba-9bcf-c078fe4619e6 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:29.464272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:29.469237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd913a4-f39e-4d71-afdc-bf0ade2adc38 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:29.469524 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd913a4-f39e-4d71-afdc-bf0ade2adc38 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:29.469801 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd913a4-f39e-4d71-afdc-bf0ade2adc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:29.514402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG passlib.handlers.bcrypt [None req-6bd913a4-f39e-4d71-afdc-bf0ade2adc38 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88404) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 22:06:29.514744 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG passlib.handlers.bcrypt [None req-6bd913a4-f39e-4d71-afdc-bf0ade2adc38 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88404) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 22:06:29.562130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-6bd913a4-f39e-4d71-afdc-bf0ade2adc38 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:29.563992 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-6bd913a4-f39e-4d71-afdc-bf0ade2adc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:29.638646 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:29.666080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:06:29.966590 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158151e-a68b-4d9a-a16a-7035db36d3e2 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:29.991297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:29.993430 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd913a4-f39e-4d71-afdc-bf0ade2adc38 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:30.074440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158151e-a68b-4d9a-a16a-7035db36d3e2 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:30.096370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd913a4-f39e-4d71-afdc-bf0ade2adc38 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:30.098695 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:30.109372 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30e98d-9bf7-4f20-998a-1aa3dcfa5f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:30.110009 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30e98d-9bf7-4f20-998a-1aa3dcfa5f5b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:30.110288 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30e98d-9bf7-4f20-998a-1aa3dcfa5f5b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:30.110574 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30e98d-9bf7-4f20-998a-1aa3dcfa5f5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:30.122822 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30e98d-9bf7-4f20-998a-1aa3dcfa5f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-4d30e98d-9bf7-4f20-998a-1aa3dcfa5f5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:30.131494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:30.132470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:06:30.133647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:30.137706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609c4f7-019a-4771-a4de-efe81e63a4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:30.138572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609c4f7-019a-4771-a4de-efe81e63a4c5 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:30.138850 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609c4f7-019a-4771-a4de-efe81e63a4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:30.139107 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30e98d-9bf7-4f20-998a-1aa3dcfa5f5b None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:30.139198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609c4f7-019a-4771-a4de-efe81e63a4c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:30.217554 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609c4f7-019a-4771-a4de-efe81e63a4c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:30.219019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609c4f7-019a-4771-a4de-efe81e63a4c5 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:30.229052 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:30.250608 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30e98d-9bf7-4f20-998a-1aa3dcfa5f5b None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:30.284868 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3ac8c-8493-4c44-b73c-f5e0f86d6f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:30.285466 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3ac8c-8493-4c44-b73c-f5e0f86d6f86 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:30.285748 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3ac8c-8493-4c44-b73c-f5e0f86d6f86 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:30.286019 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3ac8c-8493-4c44-b73c-f5e0f86d6f86 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:30.286674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3ac8c-8493-4c44-b73c-f5e0f86d6f86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:30.286973 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3ac8c-8493-4c44-b73c-f5e0f86d6f86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:30.288720 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3ac8c-8493-4c44-b73c-f5e0f86d6f86 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:30.300375 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 8/15] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:06:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:30.305966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3ac8c-8493-4c44-b73c-f5e0f86d6f86 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:30.324102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:06:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:06:30.329680 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609c4f7-019a-4771-a4de-efe81e63a4c5 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:30.332374 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:30.406731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3ac8c-8493-4c44-b73c-f5e0f86d6f86 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:30.429601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609c4f7-019a-4771-a4de-efe81e63a4c5 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:30.441879 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88120f-c2fd-455d-8d78-5b2fe8896bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:30.442504 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88120f-c2fd-455d-8d78-5b2fe8896bfc None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:30.442785 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88120f-c2fd-455d-8d78-5b2fe8896bfc None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:30.443064 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88120f-c2fd-455d-8d78-5b2fe8896bfc None admin] PATH_INFO: `/v3/users/88d08af5e2704454a689607c83d9c037` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:30.444244 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88120f-c2fd-455d-8d78-5b2fe8896bfc None admin] RBAC: Authorizing `identity:get_user(user_id=88d08af5e2704454a689607c83d9c037)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:30.445695 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88120f-c2fd-455d-8d78-5b2fe8896bfc None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:30.447251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 9/17] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:30 2022] GET /identity/v3/users/88d08af5e2704454a689607c83d9c037 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:30.453212 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88120f-c2fd-455d-8d78-5b2fe8896bfc None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:30.464572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b290f-2b2e-4a0b-b097-948e56e72665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:30.465426 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b290f-2b2e-4a0b-b097-948e56e72665 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:30.465707 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b290f-2b2e-4a0b-b097-948e56e72665 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:30.465978 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b290f-2b2e-4a0b-b097-948e56e72665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:30.467747 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:30.486794 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b290f-2b2e-4a0b-b097-948e56e72665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:30.488332 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b290f-2b2e-4a0b-b097-948e56e72665 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-113b290f-2b2e-4a0b-b097-948e56e72665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:06:30.506616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:30.507677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:06:30.508689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:06:30.508689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:06:30.508689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:06:30.508689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 9/18] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:06:30.558015 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88120f-c2fd-455d-8d78-5b2fe8896bfc None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:30.598108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a20532-d898-439d-a43b-dfe896356155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:30.598743 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a20532-d898-439d-a43b-dfe896356155 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:30.599032 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a20532-d898-439d-a43b-dfe896356155 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:30.599317 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a20532-d898-439d-a43b-dfe896356155 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:30.600529 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a20532-d898-439d-a43b-dfe896356155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:30.602030 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a20532-d898-439d-a43b-dfe896356155 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:30.603653 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 10/19] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:06:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:30.610472 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a20532-d898-439d-a43b-dfe896356155 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:30.626566 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b290f-2b2e-4a0b-b097-948e56e72665 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:30.684426 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:30.694096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:30.715985 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a20532-d898-439d-a43b-dfe896356155 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:30.732558 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b290f-2b2e-4a0b-b097-948e56e72665 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:30.749347 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cffac-9bb6-44cf-82c4-261517f043bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:30.749959 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cffac-9bb6-44cf-82c4-261517f043bb None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:30.750244 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cffac-9bb6-44cf-82c4-261517f043bb None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:30.750528 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cffac-9bb6-44cf-82c4-261517f043bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:30.751249 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cffac-9bb6-44cf-82c4-261517f043bb None admin] RBAC: Adding query filter params (role.id=81a7cb1c95fd45708dbee5e4dc91626b, scope.domain.id=default, user.id=88d08af5e2704454a689607c83d9c037) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:30.751558 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cffac-9bb6-44cf-82c4-261517f043bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:30.753066 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cffac-9bb6-44cf-82c4-261517f043bb None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:30.759649 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 11/20] 10.222.0.58 () {56 vars in 1322 bytes} [Tue Aug 23 22:06:30 2022] GET /identity/v3/role_assignments?user.id=88d08af5e2704454a689607c83d9c037&scope.domain.id=default&role.id=81a7cb1c95fd45708dbee5e4dc91626b => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:30.768723 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81debb8-10bb-4c17-aaeb-27318cabf5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:30.769360 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81debb8-10bb-4c17-aaeb-27318cabf5b5 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:30.769641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81debb8-10bb-4c17-aaeb-27318cabf5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:30.769916 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81debb8-10bb-4c17-aaeb-27318cabf5b5 None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:30.770579 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81debb8-10bb-4c17-aaeb-27318cabf5b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:30.770885 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81debb8-10bb-4c17-aaeb-27318cabf5b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:30.772379 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81debb8-10bb-4c17-aaeb-27318cabf5b5 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:30.793910 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 10/21] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:33.146773 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e27f3-3ffb-4559-b406-93d897bacba9 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:33.147782 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e27f3-3ffb-4559-b406-93d897bacba9 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:33.148318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e27f3-3ffb-4559-b406-93d897bacba9 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:33.149882 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 12/22] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:33.155964 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fc56a-41a0-4969-87c2-bcd041379497 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:33.156875 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fc56a-41a0-4969-87c2-bcd041379497 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:33.157376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fc56a-41a0-4969-87c2-bcd041379497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:33.176313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-461fc56a-41a0-4969-87c2-bcd041379497 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:33.177819 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-461fc56a-41a0-4969-87c2-bcd041379497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:33.260627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 11/23] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:33.377148 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81877-7ec0-4c02-ace6-64e38a8acb00 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:33.377771 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81877-7ec0-4c02-ace6-64e38a8acb00 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:33.378244 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a81877-7ec0-4c02-ace6-64e38a8acb00 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:33.379785 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:33.385846 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d3c42-04ec-4d56-800e-fb3439c339c5 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:33.386141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d3c42-04ec-4d56-800e-fb3439c339c5 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:33.386586 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d3c42-04ec-4d56-800e-fb3439c339c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:33.416937 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-074d3c42-04ec-4d56-800e-fb3439c339c5 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:33.418512 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-074d3c42-04ec-4d56-800e-fb3439c339c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:33.476589 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:33.513562 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 12/25] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:33.765878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a81877-7ec0-4c02-ace6-64e38a8acb00 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:33.859956 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204cadc-a666-4398-a7c4-581e955fcbcb None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:33.860600 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204cadc-a666-4398-a7c4-581e955fcbcb None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:33.861078 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204cadc-a666-4398-a7c4-581e955fcbcb None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:33.862696 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 13/26] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:06:33.868324 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba6a2d-80cc-4ac8-8f8c-8e0517aceaef None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:33.868867 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba6a2d-80cc-4ac8-8f8c-8e0517aceaef None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:33.869355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba6a2d-80cc-4ac8-8f8c-8e0517aceaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:33.892046 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-2fba6a2d-80cc-4ac8-8f8c-8e0517aceaef None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:33.893638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-2fba6a2d-80cc-4ac8-8f8c-8e0517aceaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:33.916707 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a81877-7ec0-4c02-ace6-64e38a8acb00 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:33.978264 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 14/27] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:06:33.984263 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7024-5f71-4334-8c1a-9cf014390477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:33.985239 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7024-5f71-4334-8c1a-9cf014390477 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:33.985726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7024-5f71-4334-8c1a-9cf014390477 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:33.986282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7024-5f71-4334-8c1a-9cf014390477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:34.002143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf7024-5f71-4334-8c1a-9cf014390477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-60cf7024-5f71-4334-8c1a-9cf014390477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:34.007414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:34.008297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:34.009068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:34.009068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:34.009068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:34.009068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:34.009068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:34.009068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:34.009068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:34.009068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:34.009068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:34.009068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:34.009068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:06:34.009068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:06:34.012267 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 14/28] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:06:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:34.018522 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba6a2d-80cc-4ac8-8f8c-8e0517aceaef None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:34.118746 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7024-5f71-4334-8c1a-9cf014390477 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:34.124379 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:34.170760 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba6a2d-80cc-4ac8-8f8c-8e0517aceaef None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:34.185859 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:34.272110 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7024-5f71-4334-8c1a-9cf014390477 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:34.276532 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff19a9-2240-4637-bdde-fcb599767d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:34.277419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff19a9-2240-4637-bdde-fcb599767d04 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:34.277900 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff19a9-2240-4637-bdde-fcb599767d04 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:34.278391 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff19a9-2240-4637-bdde-fcb599767d04 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:34.279258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff19a9-2240-4637-bdde-fcb599767d04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:34.279755 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff19a9-2240-4637-bdde-fcb599767d04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:34.281401 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff19a9-2240-4637-bdde-fcb599767d04 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:34.305928 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 15/29] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:06:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:34.312224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff19a9-2240-4637-bdde-fcb599767d04 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:34.317938 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ae0bc-3904-4a4f-a177-acbd25b20f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:34.319334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ae0bc-3904-4a4f-a177-acbd25b20f0a None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:34.319777 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ae0bc-3904-4a4f-a177-acbd25b20f0a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:34.320242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ae0bc-3904-4a4f-a177-acbd25b20f0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:34.343742 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ae0bc-3904-4a4f-a177-acbd25b20f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:34.346072 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ae0bc-3904-4a4f-a177-acbd25b20f0a None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-397ae0bc-3904-4a4f-a177-acbd25b20f0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:06:34.378150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:34.379241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:06:34.380180 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:06:34.380180 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:06:34.380180 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:06:34.380180 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 15/30] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:06:34.389481 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ae0bc-3904-4a4f-a177-acbd25b20f0a None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:34.459716 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:34.519221 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ae0bc-3904-4a4f-a177-acbd25b20f0a None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:34.563512 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33204b17-2a6c-43a2-aeea-67b8442eca43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:34.564072 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33204b17-2a6c-43a2-aeea-67b8442eca43 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:34.564351 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33204b17-2a6c-43a2-aeea-67b8442eca43 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:34.564621 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33204b17-2a6c-43a2-aeea-67b8442eca43 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:34.565267 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33204b17-2a6c-43a2-aeea-67b8442eca43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:34.565567 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33204b17-2a6c-43a2-aeea-67b8442eca43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:34.566962 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33204b17-2a6c-43a2-aeea-67b8442eca43 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:34.575533 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff19a9-2240-4637-bdde-fcb599767d04 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:34.616634 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 16/31] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:34.617567 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33204b17-2a6c-43a2-aeea-67b8442eca43 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:34.627386 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac1196-d736-452f-98a1-121cad89fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:34.628904 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac1196-d736-452f-98a1-121cad89fc2d None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:34.629194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac1196-d736-452f-98a1-121cad89fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:34.629472 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac1196-d736-452f-98a1-121cad89fc2d None admin] PATH_INFO: `/v3/users/88d08af5e2704454a689607c83d9c037` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:34.636442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac1196-d736-452f-98a1-121cad89fc2d None admin] RBAC: Authorizing `identity:get_user(user_id=88d08af5e2704454a689607c83d9c037)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:34.638128 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac1196-d736-452f-98a1-121cad89fc2d None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:34.648391 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 16/32] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:34 2022] GET /identity/v3/users/88d08af5e2704454a689607c83d9c037 => generated 247 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:34.649974 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac1196-d736-452f-98a1-121cad89fc2d None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:34.708199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:34.767494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33204b17-2a6c-43a2-aeea-67b8442eca43 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:34.787536 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:34.795600 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac1196-d736-452f-98a1-121cad89fc2d None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:34.810370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababa686-ca5b-46c1-b51b-9744f81403eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:34.811194 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababa686-ca5b-46c1-b51b-9744f81403eb None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:34.811583 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababa686-ca5b-46c1-b51b-9744f81403eb None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:34.812016 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababa686-ca5b-46c1-b51b-9744f81403eb None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:34.812921 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababa686-ca5b-46c1-b51b-9744f81403eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:34.814593 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababa686-ca5b-46c1-b51b-9744f81403eb None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:34.844237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf35b1-2dad-4021-83e2-717aee0097f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:34.844856 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf35b1-2dad-4021-83e2-717aee0097f3 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:34.845142 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf35b1-2dad-4021-83e2-717aee0097f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:34.845524 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf35b1-2dad-4021-83e2-717aee0097f3 None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:34.846514 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf35b1-2dad-4021-83e2-717aee0097f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:34.848161 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf35b1-2dad-4021-83e2-717aee0097f3 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:34.976220 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 17/33] 10.222.0.58 () {60 vars in 1131 bytes} [Tue Aug 23 22:06:34 2022] POST /identity/v3/roles => generated 219 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:06:34.977663 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababa686-ca5b-46c1-b51b-9744f81403eb None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:35.005936 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 17/34] 10.222.0.58 () {60 vars in 1141 bytes} [Tue Aug 23 22:06:34 2022] POST /identity/v3/projects => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:06:35.008245 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfb07b-87f8-4515-95cf-173b6199c7f0 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:35.008611 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfb07b-87f8-4515-95cf-173b6199c7f0 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:35.008893 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfb07b-87f8-4515-95cf-173b6199c7f0 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:35.011272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 18/35] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:35.026620 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4da0f-f8bb-4eff-800b-594b16c0c6fb None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:35.026982 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4da0f-f8bb-4eff-800b-594b16c0c6fb None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:35.027160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4da0f-f8bb-4eff-800b-594b16c0c6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:35.083691 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-5bf4da0f-f8bb-4eff-800b-594b16c0c6fb None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:35.085338 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-5bf4da0f-f8bb-4eff-800b-594b16c0c6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:35.199161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababa686-ca5b-46c1-b51b-9744f81403eb None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:35.241706 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e2ab-bdf5-4f09-a8b6-96fd9fd4646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:35.243785 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e2ab-bdf5-4f09-a8b6-96fd9fd4646f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:35.243785 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e2ab-bdf5-4f09-a8b6-96fd9fd4646f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:35.243785 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204e2ab-bdf5-4f09-a8b6-96fd9fd4646f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:35.247856 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204e2ab-bdf5-4f09-a8b6-96fd9fd4646f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:35.247994 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204e2ab-bdf5-4f09-a8b6-96fd9fd4646f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:35.249915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 18/36] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:35.250364 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 19/37] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:06:35.265226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e2ab-bdf5-4f09-a8b6-96fd9fd4646f None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:35.336389 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:35.369355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a632078-d813-49bc-8ecb-85ef590def56 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:35.369657 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a632078-d813-49bc-8ecb-85ef590def56 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:35.371517 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a632078-d813-49bc-8ecb-85ef590def56 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:35.373188 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 20/38] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:35.379135 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16e192-d0fc-4b64-9760-6a2f627a3f28 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:35.379706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16e192-d0fc-4b64-9760-6a2f627a3f28 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:35.380199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16e192-d0fc-4b64-9760-6a2f627a3f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:35.405621 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204e2ab-bdf5-4f09-a8b6-96fd9fd4646f None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:35.407478 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-2c16e192-d0fc-4b64-9760-6a2f627a3f28 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:35.408963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-2c16e192-d0fc-4b64-9760-6a2f627a3f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:35.440624 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:35.458737 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527638-cea9-4542-a4f5-062067913d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:35.459423 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527638-cea9-4542-a4f5-062067913d9e None admin] REQUEST_METHOD: `PUT` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:35.459767 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527638-cea9-4542-a4f5-062067913d9e None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:35.460094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527638-cea9-4542-a4f5-062067913d9e None admin] PATH_INFO: `/v3/domains/default/users/88d08af5e2704454a689607c83d9c037/roles/81a7cb1c95fd45708dbee5e4dc91626b` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:35.462751 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab527638-cea9-4542-a4f5-062067913d9e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=88d08af5e2704454a689607c83d9c037, role_id=81a7cb1c95fd45708dbee5e4dc91626b)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:35.464480 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab527638-cea9-4542-a4f5-062067913d9e None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:35.487724 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 19/39] 10.222.0.58 () {58 vars in 1361 bytes} [Tue Aug 23 22:06:35 2022] PUT /identity/v3/domains/default/users/88d08af5e2704454a689607c83d9c037/roles/81a7cb1c95fd45708dbee5e4dc91626b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:06:35.490120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0812a5-0066-485b-9757-92fdffcf074a None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:35.490421 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0812a5-0066-485b-9757-92fdffcf074a None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:35.490799 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0812a5-0066-485b-9757-92fdffcf074a None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:35.492520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 20/40] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:35.499945 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07f216-acd2-4d00-b88c-6d89a9a56910 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:35.500281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07f216-acd2-4d00-b88c-6d89a9a56910 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:35.500747 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07f216-acd2-4d00-b88c-6d89a9a56910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:35.519267 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 21/41] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:35.523996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-ad07f216-acd2-4d00-b88c-6d89a9a56910 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:35.526507 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-ad07f216-acd2-4d00-b88c-6d89a9a56910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:35.615748 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 21/42] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:06:35.684215 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16e192-d0fc-4b64-9760-6a2f627a3f28 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:35.863863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16e192-d0fc-4b64-9760-6a2f627a3f28 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:35.900070 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07f216-acd2-4d00-b88c-6d89a9a56910 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:35.925259 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5bb83-fe7a-4716-85e6-412dfd232d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:35.925883 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5bb83-fe7a-4716-85e6-412dfd232d3a None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:35.926168 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5bb83-fe7a-4716-85e6-412dfd232d3a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:35.926444 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d5bb83-fe7a-4716-85e6-412dfd232d3a None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:35.927130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5bb83-fe7a-4716-85e6-412dfd232d3a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:35.929122 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d5bb83-fe7a-4716-85e6-412dfd232d3a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:35.959530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 22/43] 10.222.0.58 () {60 vars in 1131 bytes} [Tue Aug 23 22:06:35 2022] POST /identity/v3/roles => generated 225 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:06:35.963819 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:35.990098 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5bb83-fe7a-4716-85e6-412dfd232d3a None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:36.003258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:36.065928 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07f216-acd2-4d00-b88c-6d89a9a56910 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:36.108067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ccf78-2c95-40b7-879e-ad8ab16c312e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:36.108818 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ccf78-2c95-40b7-879e-ad8ab16c312e None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:36.109297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ccf78-2c95-40b7-879e-ad8ab16c312e None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:36.109665 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ccf78-2c95-40b7-879e-ad8ab16c312e None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:36.110704 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ccf78-2c95-40b7-879e-ad8ab16c312e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:36.112384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ccf78-2c95-40b7-879e-ad8ab16c312e None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:36.129804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 22/44] 10.222.0.58 () {60 vars in 1131 bytes} [Tue Aug 23 22:06:35 2022] POST /identity/v3/roles => generated 223 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:06:36.139587 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d5bb83-fe7a-4716-85e6-412dfd232d3a None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:36.185551 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d12069-6fc7-4beb-a81c-1d5a935ebdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:36.186375 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d12069-6fc7-4beb-a81c-1d5a935ebdca None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:36.186677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d12069-6fc7-4beb-a81c-1d5a935ebdca None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:36.186959 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d12069-6fc7-4beb-a81c-1d5a935ebdca None admin] PATH_INFO: `/v3/domains/default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:36.188255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d12069-6fc7-4beb-a81c-1d5a935ebdca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:36.189793 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d12069-6fc7-4beb-a81c-1d5a935ebdca None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:36.191700 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 23/45] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:06:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:36.198243 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ccf78-2c95-40b7-879e-ad8ab16c312e None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:36.320979 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:36.330712 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ccf78-2c95-40b7-879e-ad8ab16c312e None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:36.369093 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273586b-2bda-4ffe-be2a-eea4128035a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:36.369796 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273586b-2bda-4ffe-be2a-eea4128035a0 None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:36.370050 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273586b-2bda-4ffe-be2a-eea4128035a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:36.370333 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273586b-2bda-4ffe-be2a-eea4128035a0 None admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:36.371043 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273586b-2bda-4ffe-be2a-eea4128035a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:36.372505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273586b-2bda-4ffe-be2a-eea4128035a0 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:36.402597 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 23/46] 10.222.0.58 () {60 vars in 1141 bytes} [Tue Aug 23 22:06:36 2022] POST /identity/v3/projects => generated 312 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:06:37.817732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa58fb-74ba-475d-80f5-1ec6022b17a2 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:37.818269 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa58fb-74ba-475d-80f5-1ec6022b17a2 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:37.818406 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa58fb-74ba-475d-80f5-1ec6022b17a2 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:37.819747 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 24/47] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:37.825154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecdfba-422c-4dd8-a156-87bd3bf856a5 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:37.825541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecdfba-422c-4dd8-a156-87bd3bf856a5 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:37.825717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecdfba-422c-4dd8-a156-87bd3bf856a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:37.843923 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-aaecdfba-422c-4dd8-a156-87bd3bf856a5 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:37.845099 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-aaecdfba-422c-4dd8-a156-87bd3bf856a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:37.911428 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 24/48] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:38.243392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa58fb-74ba-475d-80f5-1ec6022b17a2 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:38.321859 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:38.347194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa58fb-74ba-475d-80f5-1ec6022b17a2 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:38.381056 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929462a-bbed-465c-b8b4-a10e7669c209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:38.381684 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929462a-bbed-465c-b8b4-a10e7669c209 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:38.381964 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929462a-bbed-465c-b8b4-a10e7669c209 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:38.382236 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929462a-bbed-465c-b8b4-a10e7669c209 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:38.394243 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929462a-bbed-465c-b8b4-a10e7669c209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-7929462a-bbed-465c-b8b4-a10e7669c209 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:38.400400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:38.401419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:06:38.402247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 25/49] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:06:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:38.407741 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecdfba-422c-4dd8-a156-87bd3bf856a5 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:38.488782 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:38.513842 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecdfba-422c-4dd8-a156-87bd3bf856a5 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:38.547187 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc6fd0-618f-43ec-8bc9-b57e1dd4c266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:38.547793 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc6fd0-618f-43ec-8bc9-b57e1dd4c266 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:38.548103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc6fd0-618f-43ec-8bc9-b57e1dd4c266 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:38.548373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc6fd0-618f-43ec-8bc9-b57e1dd4c266 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:38.549031 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc6fd0-618f-43ec-8bc9-b57e1dd4c266 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:38.549331 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc6fd0-618f-43ec-8bc9-b57e1dd4c266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:38.550984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc6fd0-618f-43ec-8bc9-b57e1dd4c266 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:38.560155 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 25/50] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:06:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:38.565929 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929462a-bbed-465c-b8b4-a10e7669c209 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:38.611226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023f45-b150-4a35-a629-e40d4e5ed700 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:38.611509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023f45-b150-4a35-a629-e40d4e5ed700 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:38.611785 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023f45-b150-4a35-a629-e40d4e5ed700 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:38.613126 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 26/51] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:06:38.618098 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07ff55-fc5b-469f-96e5-8a6534eeee40 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:38.618384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07ff55-fc5b-469f-96e5-8a6534eeee40 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:38.618658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07ff55-fc5b-469f-96e5-8a6534eeee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:38.637446 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-9b07ff55-fc5b-469f-96e5-8a6534eeee40 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:38.638632 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-9b07ff55-fc5b-469f-96e5-8a6534eeee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:38.668658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929462a-bbed-465c-b8b4-a10e7669c209 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:38.703308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68f78-9c43-4676-a513-49c71b4c4a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:38.703971 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68f78-9c43-4676-a513-49c71b4c4a33 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:38.704260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68f78-9c43-4676-a513-49c71b4c4a33 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:38.704535 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68f78-9c43-4676-a513-49c71b4c4a33 None admin] PATH_INFO: `/v3/users/88d08af5e2704454a689607c83d9c037` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:38.705653 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e68f78-9c43-4676-a513-49c71b4c4a33 None admin] RBAC: Authorizing `identity:get_user(user_id=88d08af5e2704454a689607c83d9c037)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:38.706145 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 27/52] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:06:38.707127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e68f78-9c43-4676-a513-49c71b4c4a33 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:38.708838 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:38 2022] GET /identity/v3/users/88d08af5e2704454a689607c83d9c037 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:38.714086 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07ff55-fc5b-469f-96e5-8a6534eeee40 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:38.779035 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:38.816196 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07ff55-fc5b-469f-96e5-8a6534eeee40 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:38.850728 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646ae22-22d9-418e-bb72-1659f7a2be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:38.851361 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646ae22-22d9-418e-bb72-1659f7a2be4a None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:38.851647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646ae22-22d9-418e-bb72-1659f7a2be4a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:38.851960 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646ae22-22d9-418e-bb72-1659f7a2be4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:38.853066 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646ae22-22d9-418e-bb72-1659f7a2be4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:38.855179 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646ae22-22d9-418e-bb72-1659f7a2be4a None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:38.856782 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 28/54] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:06:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:38.862471 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68f78-9c43-4676-a513-49c71b4c4a33 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:38.866366 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:38.962444 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68f78-9c43-4676-a513-49c71b4c4a33 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:38.995705 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307c8a0-2180-49dc-96bf-5db6b925929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:38.996337 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307c8a0-2180-49dc-96bf-5db6b925929c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:38.996624 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307c8a0-2180-49dc-96bf-5db6b925929c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:38.996900 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307c8a0-2180-49dc-96bf-5db6b925929c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:38.997616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307c8a0-2180-49dc-96bf-5db6b925929c None admin] RBAC: Adding query filter params (role.id=81a7cb1c95fd45708dbee5e4dc91626b, scope.domain.id=default, user.id=88d08af5e2704454a689607c83d9c037) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:38.997923 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307c8a0-2180-49dc-96bf-5db6b925929c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:38.999378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307c8a0-2180-49dc-96bf-5db6b925929c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:39.007909 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1322 bytes} [Tue Aug 23 22:06:38 2022] GET /identity/v3/role_assignments?user.id=88d08af5e2704454a689607c83d9c037&scope.domain.id=default&role.id=81a7cb1c95fd45708dbee5e4dc91626b => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:39.030888 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646ae22-22d9-418e-bb72-1659f7a2be4a None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:39.141557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646ae22-22d9-418e-bb72-1659f7a2be4a None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:39.177854 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67759b-2f93-4517-9720-562b0e8d7ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:39.178490 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67759b-2f93-4517-9720-562b0e8d7ca0 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:39.178775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67759b-2f93-4517-9720-562b0e8d7ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:39.179050 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67759b-2f93-4517-9720-562b0e8d7ca0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:39.180204 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67759b-2f93-4517-9720-562b0e8d7ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:39.182234 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67759b-2f93-4517-9720-562b0e8d7ca0 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:39.183897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 29/56] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:06:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:39.189555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307c8a0-2180-49dc-96bf-5db6b925929c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:39.265012 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:39.300424 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307c8a0-2180-49dc-96bf-5db6b925929c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:39.333982 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14289eeb-f6ac-4f88-ac6d-460450de2cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:39.334589 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14289eeb-f6ac-4f88-ac6d-460450de2cc8 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:39.334874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14289eeb-f6ac-4f88-ac6d-460450de2cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:39.335153 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14289eeb-f6ac-4f88-ac6d-460450de2cc8 None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:39.335798 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14289eeb-f6ac-4f88-ac6d-460450de2cc8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:39.337300 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14289eeb-f6ac-4f88-ac6d-460450de2cc8 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:39.363321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 28/57] 10.222.0.58 () {60 vars in 1140 bytes} [Tue Aug 23 22:06:39 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:06:41.535497 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc52ae-194e-46f4-b8de-36b281f1d0e6 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:41.536030 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc52ae-194e-46f4-b8de-36b281f1d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:41.536030 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc52ae-194e-46f4-b8de-36b281f1d0e6 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:41.537317 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 30/58] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:41.543509 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1c640-919f-4af9-b645-438bf46176af None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:41.543961 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1c640-919f-4af9-b645-438bf46176af None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:41.544087 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1c640-919f-4af9-b645-438bf46176af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:41.562192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-eca1c640-919f-4af9-b645-438bf46176af None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:41.563382 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-eca1c640-919f-4af9-b645-438bf46176af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:41.630053 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 29/59] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:41.958313 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc52ae-194e-46f4-b8de-36b281f1d0e6 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:41.962204 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:42.059538 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc52ae-194e-46f4-b8de-36b281f1d0e6 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:42.092298 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95891d4c-1b37-408a-9475-37d7186680f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:42.092915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891d4c-1b37-408a-9475-37d7186680f3 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:42.093195 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891d4c-1b37-408a-9475-37d7186680f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:42.093467 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891d4c-1b37-408a-9475-37d7186680f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:42.094560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95891d4c-1b37-408a-9475-37d7186680f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:42.096299 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95891d4c-1b37-408a-9475-37d7186680f3 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:42.097822 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 31/60] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:06:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:42.103311 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1c640-919f-4af9-b645-438bf46176af None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:42.152816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:42.203123 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1c640-919f-4af9-b645-438bf46176af None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:42.236562 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec1125-b29a-4f79-8c55-e3df6fe5ec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:42.237170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec1125-b29a-4f79-8c55-e3df6fe5ec97 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:42.237455 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec1125-b29a-4f79-8c55-e3df6fe5ec97 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:42.237733 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec1125-b29a-4f79-8c55-e3df6fe5ec97 None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:42.238381 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec1125-b29a-4f79-8c55-e3df6fe5ec97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:42.239871 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec1125-b29a-4f79-8c55-e3df6fe5ec97 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:42.266896 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 30/61] 10.222.0.58 () {60 vars in 1132 bytes} [Tue Aug 23 22:06:42 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:06:45.680065 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e74c55-eca5-4981-81df-29d3b528fe58 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:45.680065 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e74c55-eca5-4981-81df-29d3b528fe58 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:45.680065 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e74c55-eca5-4981-81df-29d3b528fe58 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:45.681365 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 32/62] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:45.687999 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28b3d1-74ce-4ffd-8236-683f4b433020 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:45.688887 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28b3d1-74ce-4ffd-8236-683f4b433020 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:45.689329 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28b3d1-74ce-4ffd-8236-683f4b433020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:45.717911 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-4b28b3d1-74ce-4ffd-8236-683f4b433020 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:45.719454 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-4b28b3d1-74ce-4ffd-8236-683f4b433020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:45.782363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714f1e-6662-461f-ac77-5334f5ed3ab5 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:45.782930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714f1e-6662-461f-ac77-5334f5ed3ab5 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:45.783385 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714f1e-6662-461f-ac77-5334f5ed3ab5 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:45.784921 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 33/63] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:06:45.791189 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54976d13-19be-42f6-b0d4-71afd89aea13 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:45.792161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54976d13-19be-42f6-b0d4-71afd89aea13 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:45.792678 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54976d13-19be-42f6-b0d4-71afd89aea13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:45.828512 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-54976d13-19be-42f6-b0d4-71afd89aea13 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:45.829763 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-54976d13-19be-42f6-b0d4-71afd89aea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:45.840674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 31/64] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:45.855145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e27f52-01dc-49a6-ba5f-6d96cf482285 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:45.855435 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e27f52-01dc-49a6-ba5f-6d96cf482285 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:45.855716 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e27f52-01dc-49a6-ba5f-6d96cf482285 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:45.857090 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 32/65] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:06:45.868060 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6f93e-b724-4184-a707-ea3119a4ad91 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:45.868351 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6f93e-b724-4184-a707-ea3119a4ad91 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:45.868631 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6f93e-b724-4184-a707-ea3119a4ad91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:45.895483 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-2dd6f93e-b724-4184-a707-ea3119a4ad91 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:45.896744 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-2dd6f93e-b724-4184-a707-ea3119a4ad91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:45.952625 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:45.982316 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 34/66] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:45.996153 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 33/67] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:06:46.202988 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54976d13-19be-42f6-b0d4-71afd89aea13 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:46.205972 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:46.299661 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc218cd1-2c4d-4821-a60d-9a8a1c1278ee None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:46.300001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc218cd1-2c4d-4821-a60d-9a8a1c1278ee None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:46.300264 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc218cd1-2c4d-4821-a60d-9a8a1c1278ee None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:46.301759 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 34/68] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:06:46.309738 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210ac0f-ff68-44a0-8058-b04ec9e3d825 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:46.311016 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210ac0f-ff68-44a0-8058-b04ec9e3d825 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:46.311542 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210ac0f-ff68-44a0-8058-b04ec9e3d825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:46.339685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54976d13-19be-42f6-b0d4-71afd89aea13 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:46.361018 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-7210ac0f-ff68-44a0-8058-b04ec9e3d825 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:46.362272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-7210ac0f-ff68-44a0-8058-b04ec9e3d825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:46.381380 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fa9ff-6b24-42b0-9d73-d2047ce20016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:46.382317 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fa9ff-6b24-42b0-9d73-d2047ce20016 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:46.382811 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fa9ff-6b24-42b0-9d73-d2047ce20016 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:46.383274 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fa9ff-6b24-42b0-9d73-d2047ce20016 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:46.394484 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fa9ff-6b24-42b0-9d73-d2047ce20016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-753fa9ff-6b24-42b0-9d73-d2047ce20016 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:46.400582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:46.401476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:46.402240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:46.402240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:46.402240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:46.402240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:46.402240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:46.402240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:46.402240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:46.402240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:46.402240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:46.402240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:46.402240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:06:46.402240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:06:46.404510 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 35/69] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:06:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:46.410192 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fa9ff-6b24-42b0-9d73-d2047ce20016 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:46.481477 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 35/70] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:06:46.482896 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210ac0f-ff68-44a0-8058-b04ec9e3d825 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:46.504576 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:46.550577 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fa9ff-6b24-42b0-9d73-d2047ce20016 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:46.588286 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd8b14-5911-42f7-a4a7-8144d84ce5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:46.588975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd8b14-5911-42f7-a4a7-8144d84ce5e2 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:46.589264 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd8b14-5911-42f7-a4a7-8144d84ce5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:46.589537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd8b14-5911-42f7-a4a7-8144d84ce5e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:46.590211 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd8b14-5911-42f7-a4a7-8144d84ce5e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:46.590520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd8b14-5911-42f7-a4a7-8144d84ce5e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:46.592010 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd8b14-5911-42f7-a4a7-8144d84ce5e2 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:46.593097 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:46.601054 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210ac0f-ff68-44a0-8058-b04ec9e3d825 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:46.606723 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 36/71] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:06:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:46.606723 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd8b14-5911-42f7-a4a7-8144d84ce5e2 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:46.644423 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfd5ab-cef9-466c-b11c-b57d64e45ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:46.645049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfd5ab-cef9-466c-b11c-b57d64e45ae5 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:46.645329 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfd5ab-cef9-466c-b11c-b57d64e45ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:46.645599 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfd5ab-cef9-466c-b11c-b57d64e45ae5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:46.656593 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfd5ab-cef9-466c-b11c-b57d64e45ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-66dfd5ab-cef9-466c-b11c-b57d64e45ae5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:46.661271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:46.662096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 36/72] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:06:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:46.668493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac9c8f-faa4-4a61-b6eb-a64fac31da78 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:46.669345 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac9c8f-faa4-4a61-b6eb-a64fac31da78 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:46.669345 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac9c8f-faa4-4a61-b6eb-a64fac31da78 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:46.669345 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 37/73] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:46.669345 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac9c8f-faa4-4a61-b6eb-a64fac31da78 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:46.723766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd8b14-5911-42f7-a4a7-8144d84ce5e2 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:46.748150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:46.760434 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a780c-4fc2-4b12-94a9-276525db6b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:46.761075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a780c-4fc2-4b12-94a9-276525db6b29 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:46.761361 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a780c-4fc2-4b12-94a9-276525db6b29 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:46.761638 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a780c-4fc2-4b12-94a9-276525db6b29 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:46.772018 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a780c-4fc2-4b12-94a9-276525db6b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:46.772602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac9c8f-faa4-4a61-b6eb-a64fac31da78 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-de1a780c-4fc2-4b12-94a9-276525db6b29 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:46.777861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:46.778717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:06:46.779469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 37/74] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:06:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:46.780684 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a780c-4fc2-4b12-94a9-276525db6b29 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:46.810355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cc231-c2b8-4572-a158-b515a13a8c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:46.810994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cc231-c2b8-4572-a158-b515a13a8c1b None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:46.811282 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cc231-c2b8-4572-a158-b515a13a8c1b None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:46.811563 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cc231-c2b8-4572-a158-b515a13a8c1b None admin] PATH_INFO: `/v3/users/5e19a867e25a4fc5bdd3ddce61a40937` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:46.828200 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cc231-c2b8-4572-a158-b515a13a8c1b None admin] RBAC: Authorizing `identity:get_user(user_id=5e19a867e25a4fc5bdd3ddce61a40937)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:46.829682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cc231-c2b8-4572-a158-b515a13a8c1b None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:46.831358 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 38/75] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:46 2022] GET /identity/v3/users/5e19a867e25a4fc5bdd3ddce61a40937 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:46.835851 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c0a8b-39bd-4208-b025-43e6d6447a30 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:46.835851 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c0a8b-39bd-4208-b025-43e6d6447a30 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:46.835851 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c0a8b-39bd-4208-b025-43e6d6447a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:46.850869 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-0d5c0a8b-39bd-4208-b025-43e6d6447a30 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:46.852098 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-0d5c0a8b-39bd-4208-b025-43e6d6447a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:46.861297 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:46.888037 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a780c-4fc2-4b12-94a9-276525db6b29 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:46.919208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 39/76] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:46.920177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c0a8b-39bd-4208-b025-43e6d6447a30 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:46.921662 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1253c-c1cb-4147-8f29-c843e884d56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:46.922281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1253c-c1cb-4147-8f29-c843e884d56c None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:46.922568 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1253c-c1cb-4147-8f29-c843e884d56c None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:46.922842 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1253c-c1cb-4147-8f29-c843e884d56c None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:46.923513 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1253c-c1cb-4147-8f29-c843e884d56c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:46.923852 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1253c-c1cb-4147-8f29-c843e884d56c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:46.925259 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1253c-c1cb-4147-8f29-c843e884d56c None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:46.934834 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 38/77] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:06:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:46.935649 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1253c-c1cb-4147-8f29-c843e884d56c None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:46.988686 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:47.029314 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c0a8b-39bd-4208-b025-43e6d6447a30 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:47.045103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1253c-c1cb-4147-8f29-c843e884d56c None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:47.066974 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b8046-7d1a-42ce-adfa-ae7c29bafc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:47.067577 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b8046-7d1a-42ce-adfa-ae7c29bafc82 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:47.067873 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b8046-7d1a-42ce-adfa-ae7c29bafc82 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:47.068155 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b8046-7d1a-42ce-adfa-ae7c29bafc82 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:47.068813 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b8046-7d1a-42ce-adfa-ae7c29bafc82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:47.069113 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b8046-7d1a-42ce-adfa-ae7c29bafc82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:47.070505 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b8046-7d1a-42ce-adfa-ae7c29bafc82 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:47.078906 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 40/78] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:06:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:47.080720 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549548b3-4ee8-4569-acd8-1feee0eb04d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:47.081044 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b8046-7d1a-42ce-adfa-ae7c29bafc82 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:47.081506 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549548b3-4ee8-4569-acd8-1feee0eb04d0 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:47.081868 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549548b3-4ee8-4569-acd8-1feee0eb04d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:47.082224 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549548b3-4ee8-4569-acd8-1feee0eb04d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:47.092510 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:47.093314 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549548b3-4ee8-4569-acd8-1feee0eb04d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-549548b3-4ee8-4569-acd8-1feee0eb04d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:47.099332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:47.100229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 39/79] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:06:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:47.106954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549548b3-4ee8-4569-acd8-1feee0eb04d0 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:47.196452 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b8046-7d1a-42ce-adfa-ae7c29bafc82 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:47.211800 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549548b3-4ee8-4569-acd8-1feee0eb04d0 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:47.221143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:47.240067 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98420ab-90c3-4867-94bd-c1eaddbde664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:47.240685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98420ab-90c3-4867-94bd-c1eaddbde664 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:47.240970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98420ab-90c3-4867-94bd-c1eaddbde664 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:47.241247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98420ab-90c3-4867-94bd-c1eaddbde664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:47.259118 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed41920-5a8d-4c10-a520-d61be1823d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:47.260383 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed41920-5a8d-4c10-a520-d61be1823d7c None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:47.260665 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed41920-5a8d-4c10-a520-d61be1823d7c None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:47.260941 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed41920-5a8d-4c10-a520-d61be1823d7c None admin] PATH_INFO: `/v3/users/88d08af5e2704454a689607c83d9c037` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:47.262093 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed41920-5a8d-4c10-a520-d61be1823d7c None admin] RBAC: Authorizing `identity:get_user(user_id=88d08af5e2704454a689607c83d9c037)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:47.263552 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed41920-5a8d-4c10-a520-d61be1823d7c None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:47.265233 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 40/80] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:47 2022] GET /identity/v3/users/88d08af5e2704454a689607c83d9c037 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:47.265991 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed41920-5a8d-4c10-a520-d61be1823d7c None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:47.311033 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98420ab-90c3-4867-94bd-c1eaddbde664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:47.312479 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98420ab-90c3-4867-94bd-c1eaddbde664 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:47.320017 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:47.372351 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed41920-5a8d-4c10-a520-d61be1823d7c None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:47.406650 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb5c8d-4487-4475-beb5-a778ad64e5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:47.407280 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb5c8d-4487-4475-beb5-a778ad64e5d5 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:47.407559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb5c8d-4487-4475-beb5-a778ad64e5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:47.407850 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb5c8d-4487-4475-beb5-a778ad64e5d5 None admin] PATH_INFO: `/v3/users/5e19a867e25a4fc5bdd3ddce61a40937` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:47.409015 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb5c8d-4487-4475-beb5-a778ad64e5d5 None admin] RBAC: Authorizing `identity:get_user(user_id=5e19a867e25a4fc5bdd3ddce61a40937)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:47.410484 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb5c8d-4487-4475-beb5-a778ad64e5d5 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:47.412092 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 41/81] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:47 2022] GET /identity/v3/users/5e19a867e25a4fc5bdd3ddce61a40937 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:47.413982 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb5c8d-4487-4475-beb5-a778ad64e5d5 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:47.423083 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 41/82] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:06:47.423083 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98420ab-90c3-4867-94bd-c1eaddbde664 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:47.457091 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:47.515543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb5c8d-4487-4475-beb5-a778ad64e5d5 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:47.519582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98420ab-90c3-4867-94bd-c1eaddbde664 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:47.527496 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:47.551180 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3aa266-c8ae-4bd8-b69a-b37c788e8669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:47.551781 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aa266-c8ae-4bd8-b69a-b37c788e8669 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:47.552162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aa266-c8ae-4bd8-b69a-b37c788e8669 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:47.552378 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3aa266-c8ae-4bd8-b69a-b37c788e8669 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:47.553035 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3aa266-c8ae-4bd8-b69a-b37c788e8669 None admin] RBAC: Adding query filter params (name=member) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:47.553340 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3aa266-c8ae-4bd8-b69a-b37c788e8669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:47.554727 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3aa266-c8ae-4bd8-b69a-b37c788e8669 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:47.555328 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdbe01-c934-41fe-bb3a-0a2c44855cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:47.555987 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdbe01-c934-41fe-bb3a-0a2c44855cd8 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:47.556401 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdbe01-c934-41fe-bb3a-0a2c44855cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:47.556729 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdbe01-c934-41fe-bb3a-0a2c44855cd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:47.557863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdbe01-c934-41fe-bb3a-0a2c44855cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:47.559298 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdbe01-c934-41fe-bb3a-0a2c44855cd8 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:47.560943 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 42/83] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:06:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:47.564239 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 42/84] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:06:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:47.564724 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdbe01-c934-41fe-bb3a-0a2c44855cd8 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:47.569467 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3aa266-c8ae-4bd8-b69a-b37c788e8669 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:47.664151 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdbe01-c934-41fe-bb3a-0a2c44855cd8 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:47.668578 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3aa266-c8ae-4bd8-b69a-b37c788e8669 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:47.671292 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:47.699196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87f95a-4c47-4aed-961c-f81cfeffe579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:47.699884 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87f95a-4c47-4aed-961c-f81cfeffe579 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:47.700173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87f95a-4c47-4aed-961c-f81cfeffe579 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:47.700455 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87f95a-4c47-4aed-961c-f81cfeffe579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:47.705912 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc39cb-28da-4efd-a322-a6d426a0cea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:47.706515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc39cb-28da-4efd-a322-a6d426a0cea9 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:47.706797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc39cb-28da-4efd-a322-a6d426a0cea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:47.707069 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc39cb-28da-4efd-a322-a6d426a0cea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:47.747621 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:47.774003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87f95a-4c47-4aed-961c-f81cfeffe579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:47.776313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87f95a-4c47-4aed-961c-f81cfeffe579 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:47.777787 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc39cb-28da-4efd-a322-a6d426a0cea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:47.779255 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc39cb-28da-4efd-a322-a6d426a0cea9 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:47.876458 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 43/85] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:06:47.877220 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87f95a-4c47-4aed-961c-f81cfeffe579 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:47.879530 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 43/86] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:06:47.880422 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc39cb-28da-4efd-a322-a6d426a0cea9 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:47.883907 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:47.955599 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:47.981159 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87f95a-4c47-4aed-961c-f81cfeffe579 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:47.981348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc39cb-28da-4efd-a322-a6d426a0cea9 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:48.015028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28f0a5-e125-453e-b405-b88f94441528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:48.015623 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28f0a5-e125-453e-b405-b88f94441528 None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:48.015896 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf9c6c-a802-405b-bebe-47b365b7d57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:48.016037 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28f0a5-e125-453e-b405-b88f94441528 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:48.016197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28f0a5-e125-453e-b405-b88f94441528 None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:48.016529 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf9c6c-a802-405b-bebe-47b365b7d57a None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:48.016816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf9c6c-a802-405b-bebe-47b365b7d57a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:48.016899 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28f0a5-e125-453e-b405-b88f94441528 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:48.017093 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf9c6c-a802-405b-bebe-47b365b7d57a None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:48.018228 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf9c6c-a802-405b-bebe-47b365b7d57a None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:48.018313 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28f0a5-e125-453e-b405-b88f94441528 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:48.019682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf9c6c-a802-405b-bebe-47b365b7d57a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:48.021345 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 44/87] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:06:47 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:48.022105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf9c6c-a802-405b-bebe-47b365b7d57a None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:48.045561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 44/88] 10.222.0.58 () {60 vars in 1132 bytes} [Tue Aug 23 22:06:47 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:06:48.049030 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28f0a5-e125-453e-b405-b88f94441528 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:48.119180 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:48.141254 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf9c6c-a802-405b-bebe-47b365b7d57a None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:48.168103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28f0a5-e125-453e-b405-b88f94441528 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:48.179575 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e480b9-056b-4450-bd6e-35cd144b6b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:48.180370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e480b9-056b-4450-bd6e-35cd144b6b5b None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:48.180652 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e480b9-056b-4450-bd6e-35cd144b6b5b None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:48.180929 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e480b9-056b-4450-bd6e-35cd144b6b5b None admin] PATH_INFO: `/v3/users/5e19a867e25a4fc5bdd3ddce61a40937` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:48.182763 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e480b9-056b-4450-bd6e-35cd144b6b5b None admin] RBAC: Authorizing `identity:get_user(user_id=5e19a867e25a4fc5bdd3ddce61a40937)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:48.184432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e480b9-056b-4450-bd6e-35cd144b6b5b None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:48.190734 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 45/89] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:48 2022] GET /identity/v3/users/5e19a867e25a4fc5bdd3ddce61a40937 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:48.190734 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e480b9-056b-4450-bd6e-35cd144b6b5b None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:48.203116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:48.213891 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e02020-a5bd-4618-9def-fe961aa24895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:48.214540 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e02020-a5bd-4618-9def-fe961aa24895 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:48.214820 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e02020-a5bd-4618-9def-fe961aa24895 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:48.215120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e02020-a5bd-4618-9def-fe961aa24895 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:48.216300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e02020-a5bd-4618-9def-fe961aa24895 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:48.217776 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e02020-a5bd-4618-9def-fe961aa24895 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:48.219423 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 45/90] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:06:48 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:48.222996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e02020-a5bd-4618-9def-fe961aa24895 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:48.320516 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e480b9-056b-4450-bd6e-35cd144b6b5b None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:48.354575 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e02020-a5bd-4618-9def-fe961aa24895 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:48.369605 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65608ce-7a44-4808-b5a3-8c12e5bbd3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:48.370807 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65608ce-7a44-4808-b5a3-8c12e5bbd3a0 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:48.371319 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65608ce-7a44-4808-b5a3-8c12e5bbd3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:48.371772 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65608ce-7a44-4808-b5a3-8c12e5bbd3a0 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:48.373675 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65608ce-7a44-4808-b5a3-8c12e5bbd3a0 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:48.375421 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65608ce-7a44-4808-b5a3-8c12e5bbd3a0 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:48.377585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 46/91] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:06:48 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:48.378366 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65608ce-7a44-4808-b5a3-8c12e5bbd3a0 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:48.393563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:48.402766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d1014-aec3-4b42-8090-c82f994cc0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:48.403379 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d1014-aec3-4b42-8090-c82f994cc0db None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:48.403663 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d1014-aec3-4b42-8090-c82f994cc0db None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:48.403967 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d1014-aec3-4b42-8090-c82f994cc0db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:48.405176 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d1014-aec3-4b42-8090-c82f994cc0db None admin] RBAC: Adding query filter params (role.id=57d5f513f8fd4d7dbd1ef0ecc319892e, scope.project.id=f40ec939fdcc422995f7ce0c3973152d, user.id=5e19a867e25a4fc5bdd3ddce61a40937) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:48.405491 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d1014-aec3-4b42-8090-c82f994cc0db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:48.407114 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d1014-aec3-4b42-8090-c82f994cc0db None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:48.413870 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 46/92] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:06:48 2022] GET /identity/v3/role_assignments?user.id=5e19a867e25a4fc5bdd3ddce61a40937&scope.project.id=f40ec939fdcc422995f7ce0c3973152d&role.id=57d5f513f8fd4d7dbd1ef0ecc319892e => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:48.414523 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d1014-aec3-4b42-8090-c82f994cc0db None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:48.485176 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:48.518583 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65608ce-7a44-4808-b5a3-8c12e5bbd3a0 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:48.544168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d1014-aec3-4b42-8090-c82f994cc0db None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:48.558976 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae25e02-a595-49a5-9e5b-001c656e90b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:48.559604 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae25e02-a595-49a5-9e5b-001c656e90b4 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:48.560072 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae25e02-a595-49a5-9e5b-001c656e90b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:48.560972 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae25e02-a595-49a5-9e5b-001c656e90b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:48.613812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b9027-191c-4933-877c-8fb3361c747b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:48.614438 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9027-191c-4933-877c-8fb3361c747b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:48.614724 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9027-191c-4933-877c-8fb3361c747b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:48.615002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9027-191c-4933-877c-8fb3361c747b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:48.615741 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b9027-191c-4933-877c-8fb3361c747b None admin] RBAC: Adding query filter params (role.id=81a7cb1c95fd45708dbee5e4dc91626b, scope.project.id=f40ec939fdcc422995f7ce0c3973152d, user.id=88d08af5e2704454a689607c83d9c037) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:48.616081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b9027-191c-4933-877c-8fb3361c747b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:48.617579 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b9027-191c-4933-877c-8fb3361c747b None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:48.637216 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 47/93] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:06:48 2022] GET /identity/v3/role_assignments?user.id=88d08af5e2704454a689607c83d9c037&scope.project.id=f40ec939fdcc422995f7ce0c3973152d&role.id=81a7cb1c95fd45708dbee5e4dc91626b => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:48.638162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b9027-191c-4933-877c-8fb3361c747b None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:48.693278 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae25e02-a595-49a5-9e5b-001c656e90b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:48.695202 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae25e02-a595-49a5-9e5b-001c656e90b4 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:48.768129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:48.840224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:48.864057 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b9027-191c-4933-877c-8fb3361c747b None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:48.888747 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 47/94] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:06:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:06:48.897991 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae25e02-a595-49a5-9e5b-001c656e90b4 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:48.945911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014615ee-d8ed-4306-854d-0ef173e8e770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:48.946445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014615ee-d8ed-4306-854d-0ef173e8e770 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:48.946808 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014615ee-d8ed-4306-854d-0ef173e8e770 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:48.947731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014615ee-d8ed-4306-854d-0ef173e8e770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:48.948889 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014615ee-d8ed-4306-854d-0ef173e8e770 None admin] RBAC: Adding query filter params (role.id=035d7eb5fa4e47919e159810a449df68, scope.project.id=f40ec939fdcc422995f7ce0c3973152d, user.id=5e19a867e25a4fc5bdd3ddce61a40937) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:48.949202 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014615ee-d8ed-4306-854d-0ef173e8e770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:48.951643 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014615ee-d8ed-4306-854d-0ef173e8e770 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:48.959763 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 48/95] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:06:48 2022] GET /identity/v3/role_assignments?user.id=5e19a867e25a4fc5bdd3ddce61a40937&scope.project.id=f40ec939fdcc422995f7ce0c3973152d&role.id=035d7eb5fa4e47919e159810a449df68 => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:49.057892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae25e02-a595-49a5-9e5b-001c656e90b4 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:49.096801 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52fbbf-6a27-4326-9f82-b7c99063977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:49.097438 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52fbbf-6a27-4326-9f82-b7c99063977d None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:49.097717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52fbbf-6a27-4326-9f82-b7c99063977d None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:49.097991 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52fbbf-6a27-4326-9f82-b7c99063977d None admin] PATH_INFO: `/v3/projects/6bf163eed2cc4200a3a41fd92cab643c` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:49.099187 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52fbbf-6a27-4326-9f82-b7c99063977d None admin] RBAC: Authorizing `identity:get_project(project_id=6bf163eed2cc4200a3a41fd92cab643c)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:49.100669 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52fbbf-6a27-4326-9f82-b7c99063977d None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:49.102313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 48/96] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:06:48 2022] GET /identity/v3/projects/6bf163eed2cc4200a3a41fd92cab643c => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:49.109097 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014615ee-d8ed-4306-854d-0ef173e8e770 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:49.220084 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014615ee-d8ed-4306-854d-0ef173e8e770 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:49.242352 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:49.258808 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0331a-54c2-4098-a2fb-22342d5c2a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:49.260065 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0331a-54c2-4098-a2fb-22342d5c2a51 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:49.260585 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0331a-54c2-4098-a2fb-22342d5c2a51 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:49.260867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0331a-54c2-4098-a2fb-22342d5c2a51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:49.261627 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0331a-54c2-4098-a2fb-22342d5c2a51 None admin] RBAC: Adding query filter params (role.id=57d5f513f8fd4d7dbd1ef0ecc319892e, scope.project.id=6bf163eed2cc4200a3a41fd92cab643c, user.id=5e19a867e25a4fc5bdd3ddce61a40937) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:49.262053 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0331a-54c2-4098-a2fb-22342d5c2a51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:49.263458 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0331a-54c2-4098-a2fb-22342d5c2a51 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:49.269674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 49/97] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:06:49 2022] GET /identity/v3/role_assignments?user.id=5e19a867e25a4fc5bdd3ddce61a40937&scope.project.id=6bf163eed2cc4200a3a41fd92cab643c&role.id=57d5f513f8fd4d7dbd1ef0ecc319892e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:51.143284 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732d8d7-56bc-4a31-b23a-98158db2ae8a None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:51.144404 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732d8d7-56bc-4a31-b23a-98158db2ae8a None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:51.144938 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732d8d7-56bc-4a31-b23a-98158db2ae8a None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:51.146463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 49/98] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:51.153145 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156455b-7221-4af0-a4ed-de904b63da79 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:51.154033 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156455b-7221-4af0-a4ed-de904b63da79 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:51.154543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156455b-7221-4af0-a4ed-de904b63da79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:51.174359 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-a156455b-7221-4af0-a4ed-de904b63da79 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:51.175965 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-a156455b-7221-4af0-a4ed-de904b63da79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:51.230357 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5c137-9185-4d24-bc4c-5a84bda6bb7b None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:51.230655 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5c137-9185-4d24-bc4c-5a84bda6bb7b None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:51.234070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5c137-9185-4d24-bc4c-5a84bda6bb7b None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:51.234070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 50/99] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:51.241532 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd245ab-2ea9-4732-8c25-1cb05ecfd3bd None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:51.241828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd245ab-2ea9-4732-8c25-1cb05ecfd3bd None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:51.242092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd245ab-2ea9-4732-8c25-1cb05ecfd3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:51.271115 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-ddd245ab-2ea9-4732-8c25-1cb05ecfd3bd None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:51.272340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-ddd245ab-2ea9-4732-8c25-1cb05ecfd3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:51.310986 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 50/100] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:51.334631 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:51.375453 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 51/101] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:06:51.756189 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e72f-9a6d-447a-95f0-d0eb7bd5ac67 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:51.756588 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e72f-9a6d-447a-95f0-d0eb7bd5ac67 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:51.756761 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e72f-9a6d-447a-95f0-d0eb7bd5ac67 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:51.758120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 51/102] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:51.762095 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd245ab-2ea9-4732-8c25-1cb05ecfd3bd None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:51.767127 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa25d1-c0da-408a-b988-0155b6e5590d None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:51.767419 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa25d1-c0da-408a-b988-0155b6e5590d None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:51.767697 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa25d1-c0da-408a-b988-0155b6e5590d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:51.805444 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-20aa25d1-c0da-408a-b988-0155b6e5590d None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:51.817550 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-20aa25d1-c0da-408a-b988-0155b6e5590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:51.932621 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 52/103] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:51.933709 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa25d1-c0da-408a-b988-0155b6e5590d None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:51.975740 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd245ab-2ea9-4732-8c25-1cb05ecfd3bd None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:51.986113 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:52.049231 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa25d1-c0da-408a-b988-0155b6e5590d None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:52.100569 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3ea9b-9014-41f9-9e6e-9ff101fdb522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:52.101275 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3ea9b-9014-41f9-9e6e-9ff101fdb522 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:52.101554 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3ea9b-9014-41f9-9e6e-9ff101fdb522 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:52.101873 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3ea9b-9014-41f9-9e6e-9ff101fdb522 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:52.107646 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc2659-1ebe-4b56-948b-4155cc7c4885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:52.108760 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc2659-1ebe-4b56-948b-4155cc7c4885 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:52.109049 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc2659-1ebe-4b56-948b-4155cc7c4885 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:52.109334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc2659-1ebe-4b56-948b-4155cc7c4885 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:52.112766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc2659-1ebe-4b56-948b-4155cc7c4885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:52.114260 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc2659-1ebe-4b56-948b-4155cc7c4885 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:52.116451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 53/104] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:06:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:52.122104 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc2659-1ebe-4b56-948b-4155cc7c4885 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:52.144378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3ea9b-9014-41f9-9e6e-9ff101fdb522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-cbe3ea9b-9014-41f9-9e6e-9ff101fdb522 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:52.149177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:52.152138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:06:52.154050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 52/105] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:06:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:52.160660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a862944-6097-47c7-9253-9a469759d269 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:52.160939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a862944-6097-47c7-9253-9a469759d269 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:52.161230 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a862944-6097-47c7-9253-9a469759d269 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:52.162542 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 53/106] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:52.163297 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a862944-6097-47c7-9253-9a469759d269 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:52.249571 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc2659-1ebe-4b56-948b-4155cc7c4885 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:52.271028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:52.288412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:52.313975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca7fb8-0a81-4feb-92fe-202b782a34e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:52.314569 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca7fb8-0a81-4feb-92fe-202b782a34e6 None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:52.314913 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca7fb8-0a81-4feb-92fe-202b782a34e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:52.315194 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca7fb8-0a81-4feb-92fe-202b782a34e6 None admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:52.317026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca7fb8-0a81-4feb-92fe-202b782a34e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:52.318494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca7fb8-0a81-4feb-92fe-202b782a34e6 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:52.371743 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 54/107] 10.222.0.58 () {60 vars in 1141 bytes} [Tue Aug 23 22:06:52 2022] POST /identity/v3/projects => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:06:52.374923 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef0f98-e49f-4047-98a6-788ec0eac77e None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:52.375317 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef0f98-e49f-4047-98a6-788ec0eac77e None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:52.375601 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef0f98-e49f-4047-98a6-788ec0eac77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:52.409591 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-27ef0f98-e49f-4047-98a6-788ec0eac77e None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:52.410896 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-27ef0f98-e49f-4047-98a6-788ec0eac77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:52.430414 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a862944-6097-47c7-9253-9a469759d269 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:52.522727 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cf441-df34-4586-914e-5af837d9e97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:52.523354 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cf441-df34-4586-914e-5af837d9e97c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:52.523635 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cf441-df34-4586-914e-5af837d9e97c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:52.523932 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cf441-df34-4586-914e-5af837d9e97c None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:52.524655 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cf441-df34-4586-914e-5af837d9e97c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:52.525192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cf441-df34-4586-914e-5af837d9e97c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:52.526911 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7cf441-df34-4586-914e-5af837d9e97c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:52.536761 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 54/108] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:06:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:52.537593 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 55/109] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:52.538018 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cf441-df34-4586-914e-5af837d9e97c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:52.543939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef0f98-e49f-4047-98a6-788ec0eac77e None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:52.660019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:52.665104 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cf441-df34-4586-914e-5af837d9e97c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:52.702413 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:52.708744 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242c38e-1254-4079-973a-c076ab9d4cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:52.709403 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242c38e-1254-4079-973a-c076ab9d4cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:52.709676 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242c38e-1254-4079-973a-c076ab9d4cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:52.709945 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242c38e-1254-4079-973a-c076ab9d4cb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:52.723070 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef0f98-e49f-4047-98a6-788ec0eac77e None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:52.724595 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242c38e-1254-4079-973a-c076ab9d4cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-f242c38e-1254-4079-973a-c076ab9d4cb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:52.731160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:52.732105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:06:52.732948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 55/110] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:06:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:52.741955 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242c38e-1254-4079-973a-c076ab9d4cb7 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:52.771052 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dbe69-725e-48bd-942c-ffb49a35baf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:52.771966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dbe69-725e-48bd-942c-ffb49a35baf2 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:52.772400 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dbe69-725e-48bd-942c-ffb49a35baf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:52.772826 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dbe69-725e-48bd-942c-ffb49a35baf2 None admin] PATH_INFO: `/v3/users/4bfc1715f2aa4c458f0171797050897a` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:52.796582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dbe69-725e-48bd-942c-ffb49a35baf2 None admin] RBAC: Authorizing `identity:get_user(user_id=4bfc1715f2aa4c458f0171797050897a)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:52.798323 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dbe69-725e-48bd-942c-ffb49a35baf2 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:52.800810 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 56/111] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:52 2022] GET /identity/v3/users/4bfc1715f2aa4c458f0171797050897a => generated 289 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:52.802216 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb489-47c4-4b24-aeec-43ac61e9a169 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:52.802649 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb489-47c4-4b24-aeec-43ac61e9a169 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:52.803074 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1eb489-47c4-4b24-aeec-43ac61e9a169 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:52.804792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 57/112] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:52.808709 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb489-47c4-4b24-aeec-43ac61e9a169 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:52.860406 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242c38e-1254-4079-973a-c076ab9d4cb7 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:52.901001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d593c-2d93-41eb-a81c-04c1c9c27ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:52.901767 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d593c-2d93-41eb-a81c-04c1c9c27ff6 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:52.902047 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d593c-2d93-41eb-a81c-04c1c9c27ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:52.902327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d593c-2d93-41eb-a81c-04c1c9c27ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:52.902992 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d593c-2d93-41eb-a81c-04c1c9c27ff6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:52.903297 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d593c-2d93-41eb-a81c-04c1c9c27ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:52.904818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d593c-2d93-41eb-a81c-04c1c9c27ff6 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:52.919998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 56/113] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:06:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:52.922024 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c3ba-2126-470b-b615-94ad70d287b9 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:52.922926 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c3ba-2126-470b-b615-94ad70d287b9 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:52.923220 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338c3ba-2126-470b-b615-94ad70d287b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:52.926485 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1eb489-47c4-4b24-aeec-43ac61e9a169 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:52.942780 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-1338c3ba-2126-470b-b615-94ad70d287b9 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:52.944228 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-1338c3ba-2126-470b-b615-94ad70d287b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:52.963087 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:52.971544 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91795781-d685-411d-b3b3-c98ba8542a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:52.972182 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91795781-d685-411d-b3b3-c98ba8542a36 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:52.972467 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91795781-d685-411d-b3b3-c98ba8542a36 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:52.972741 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91795781-d685-411d-b3b3-c98ba8542a36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:53.002056 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:53.039047 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 57/114] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:53.042300 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af4732-df22-4f39-abe3-09c8f5f7d234 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:53.043157 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af4732-df22-4f39-abe3-09c8f5f7d234 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:53.044219 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af4732-df22-4f39-abe3-09c8f5f7d234 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:53.045775 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 58/115] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:53.050262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af4732-df22-4f39-abe3-09c8f5f7d234 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:53.074463 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91795781-d685-411d-b3b3-c98ba8542a36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:53.076397 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91795781-d685-411d-b3b3-c98ba8542a36 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:53.191853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af4732-df22-4f39-abe3-09c8f5f7d234 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:53.213315 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 58/116] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:06:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:06:53.215004 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6670f-c493-4060-8d6c-2dabbf7dc4fe None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:53.215297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6670f-c493-4060-8d6c-2dabbf7dc4fe None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:53.215577 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6670f-c493-4060-8d6c-2dabbf7dc4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:53.242316 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-a0a6670f-c493-4060-8d6c-2dabbf7dc4fe None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:53.245377 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-a0a6670f-c493-4060-8d6c-2dabbf7dc4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:53.250665 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a7776-7dd6-4ec3-a374-805e7ea6b27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:53.251583 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a7776-7dd6-4ec3-a374-805e7ea6b27f None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:53.251898 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a7776-7dd6-4ec3-a374-805e7ea6b27f None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:53.252185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a7776-7dd6-4ec3-a374-805e7ea6b27f None admin] PATH_INFO: `/v3/users/5e19a867e25a4fc5bdd3ddce61a40937` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:53.253364 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a7776-7dd6-4ec3-a374-805e7ea6b27f None admin] RBAC: Authorizing `identity:get_user(user_id=5e19a867e25a4fc5bdd3ddce61a40937)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:53.255546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a7776-7dd6-4ec3-a374-805e7ea6b27f None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:53.258361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 59/117] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:53 2022] GET /identity/v3/users/5e19a867e25a4fc5bdd3ddce61a40937 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:53.259418 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a7776-7dd6-4ec3-a374-805e7ea6b27f None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:53.288299 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:53.314960 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:53.343586 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 59/118] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:53.352978 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6670f-c493-4060-8d6c-2dabbf7dc4fe None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:53.391962 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a7776-7dd6-4ec3-a374-805e7ea6b27f None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:53.427930 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7894f2-9c3d-454f-b3e0-e8d676d1d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:53.428702 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7894f2-9c3d-454f-b3e0-e8d676d1d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:53.429089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7894f2-9c3d-454f-b3e0-e8d676d1d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:53.429370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7894f2-9c3d-454f-b3e0-e8d676d1d4e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:53.441630 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7894f2-9c3d-454f-b3e0-e8d676d1d4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-ed7894f2-9c3d-454f-b3e0-e8d676d1d4e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:53.448274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:53.449138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:06:53.449905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 60/119] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:53.455106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7894f2-9c3d-454f-b3e0-e8d676d1d4e7 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:53.485271 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6670f-c493-4060-8d6c-2dabbf7dc4fe None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:53.533328 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b30f9d-9be5-4db6-9e33-230627a0ea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:53.533957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30f9d-9be5-4db6-9e33-230627a0ea33 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:53.534240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30f9d-9be5-4db6-9e33-230627a0ea33 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:53.534507 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b30f9d-9be5-4db6-9e33-230627a0ea33 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:53.536175 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b30f9d-9be5-4db6-9e33-230627a0ea33 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:53.537690 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b30f9d-9be5-4db6-9e33-230627a0ea33 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:53.544628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 60/120] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:06:53 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:53.544628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b30f9d-9be5-4db6-9e33-230627a0ea33 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:53.566503 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:53.597679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7894f2-9c3d-454f-b3e0-e8d676d1d4e7 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:53.606005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:53.647298 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58e2e8-ae5b-4dc4-8718-612001fbb2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:53.647959 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58e2e8-ae5b-4dc4-8718-612001fbb2d7 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:53.648240 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58e2e8-ae5b-4dc4-8718-612001fbb2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:53.648517 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58e2e8-ae5b-4dc4-8718-612001fbb2d7 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:53.650295 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58e2e8-ae5b-4dc4-8718-612001fbb2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:53.652052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58e2e8-ae5b-4dc4-8718-612001fbb2d7 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:53.654112 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 61/121] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:06:53 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:53.659378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58e2e8-ae5b-4dc4-8718-612001fbb2d7 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:53.672713 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b30f9d-9be5-4db6-9e33-230627a0ea33 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:53.720442 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c212fac-d67b-4b05-b5a1-648a5ff6f98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:53.721677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c212fac-d67b-4b05-b5a1-648a5ff6f98a None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:53.722414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c212fac-d67b-4b05-b5a1-648a5ff6f98a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:53.722927 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c212fac-d67b-4b05-b5a1-648a5ff6f98a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:53.736400 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c212fac-d67b-4b05-b5a1-648a5ff6f98a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-5c212fac-d67b-4b05-b5a1-648a5ff6f98a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:53.741620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:53.742482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 61/122] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:06:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:53.744710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c212fac-d67b-4b05-b5a1-648a5ff6f98a None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:53.775620 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58e2e8-ae5b-4dc4-8718-612001fbb2d7 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:53.811350 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a22e-24de-4df2-86d6-e11b2bb45a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:53.811994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a22e-24de-4df2-86d6-e11b2bb45a31 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:53.812282 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a22e-24de-4df2-86d6-e11b2bb45a31 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:53.812553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a22e-24de-4df2-86d6-e11b2bb45a31 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:53.813213 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665a22e-24de-4df2-86d6-e11b2bb45a31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:53.813526 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665a22e-24de-4df2-86d6-e11b2bb45a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:53.814906 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665a22e-24de-4df2-86d6-e11b2bb45a31 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:53.824159 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 62/123] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:53.829525 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a22e-24de-4df2-86d6-e11b2bb45a31 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:53.842348 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:53.861457 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c212fac-d67b-4b05-b5a1-648a5ff6f98a None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:53.874823 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:53.906392 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db55458-b11d-422c-b985-58e93757d6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:53.907137 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db55458-b11d-422c-b985-58e93757d6f4 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:53.908214 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db55458-b11d-422c-b985-58e93757d6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:53.908502 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db55458-b11d-422c-b985-58e93757d6f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:53.909253 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db55458-b11d-422c-b985-58e93757d6f4 None admin] RBAC: Adding query filter params (role.id=eefe4f9f49e4401a929ce82b866421d7, scope.project.id=f40ec939fdcc422995f7ce0c3973152d, user.id=4bfc1715f2aa4c458f0171797050897a) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:53.909574 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db55458-b11d-422c-b985-58e93757d6f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:53.911058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db55458-b11d-422c-b985-58e93757d6f4 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:53.927861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 62/124] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:06:53 2022] GET /identity/v3/role_assignments?user.id=4bfc1715f2aa4c458f0171797050897a&scope.project.id=f40ec939fdcc422995f7ce0c3973152d&role.id=eefe4f9f49e4401a929ce82b866421d7 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:53.927861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db55458-b11d-422c-b985-58e93757d6f4 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:53.954194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a22e-24de-4df2-86d6-e11b2bb45a31 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:54.002487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ca725-c458-40a3-bad0-f1a89909cb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:54.003085 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ca725-c458-40a3-bad0-f1a89909cb79 None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:54.003369 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ca725-c458-40a3-bad0-f1a89909cb79 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:54.003646 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ca725-c458-40a3-bad0-f1a89909cb79 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d/users/5e19a867e25a4fc5bdd3ddce61a40937/roles/57d5f513f8fd4d7dbd1ef0ecc319892e` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:54.006622 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ca725-c458-40a3-bad0-f1a89909cb79 None admin] RBAC: Authorizing `identity:create_grant(project_id=f40ec939fdcc422995f7ce0c3973152d, user_id=5e19a867e25a4fc5bdd3ddce61a40937, role_id=57d5f513f8fd4d7dbd1ef0ecc319892e)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:54.008704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ca725-c458-40a3-bad0-f1a89909cb79 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:54.035984 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 63/125] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:06:53 2022] PUT /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d/users/5e19a867e25a4fc5bdd3ddce61a40937/roles/57d5f513f8fd4d7dbd1ef0ecc319892e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:06:54.037124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ca725-c458-40a3-bad0-f1a89909cb79 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:54.066940 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db55458-b11d-422c-b985-58e93757d6f4 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:54.154797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb1fe3-2355-4c32-a5f5-4c8eb5f0da05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:54.155862 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb1fe3-2355-4c32-a5f5-4c8eb5f0da05 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:54.156379 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb1fe3-2355-4c32-a5f5-4c8eb5f0da05 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:54.156853 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb1fe3-2355-4c32-a5f5-4c8eb5f0da05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:54.174116 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb1fe3-2355-4c32-a5f5-4c8eb5f0da05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-b9cb1fe3-2355-4c32-a5f5-4c8eb5f0da05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:54.182261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:54.183183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:54.183968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:54.183968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:54.183968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:54.183968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:54.183968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:54.183968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:54.183968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:54.183968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:54.183968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:54.183968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:54.183968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:06:54.183968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:06:54.186200 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:54.188267 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 63/126] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:06:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:54.189504 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb1fe3-2355-4c32-a5f5-4c8eb5f0da05 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:54.247917 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:54.288555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ca725-c458-40a3-bad0-f1a89909cb79 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:54.327332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb1fe3-2355-4c32-a5f5-4c8eb5f0da05 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:54.336939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82961f2-0332-441e-9aea-5a703307dbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:54.338228 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82961f2-0332-441e-9aea-5a703307dbd0 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:54.338803 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82961f2-0332-441e-9aea-5a703307dbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:54.339184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82961f2-0332-441e-9aea-5a703307dbd0 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:54.340190 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82961f2-0332-441e-9aea-5a703307dbd0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:54.341834 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82961f2-0332-441e-9aea-5a703307dbd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:54.343237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82961f2-0332-441e-9aea-5a703307dbd0 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:54.354756 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 64/127] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:06:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:54.355692 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82961f2-0332-441e-9aea-5a703307dbd0 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:54.391383 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc336513-d3e2-4ad7-803e-204506adf410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:54.392053 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc336513-d3e2-4ad7-803e-204506adf410 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:54.392333 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc336513-d3e2-4ad7-803e-204506adf410 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:54.392604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc336513-d3e2-4ad7-803e-204506adf410 None admin] PATH_INFO: `/v3/users/88d08af5e2704454a689607c83d9c037` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:54.394520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc336513-d3e2-4ad7-803e-204506adf410 None admin] RBAC: Authorizing `identity:get_user(user_id=88d08af5e2704454a689607c83d9c037)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:54.398427 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc336513-d3e2-4ad7-803e-204506adf410 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:54.401101 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 64/128] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:54 2022] GET /identity/v3/users/88d08af5e2704454a689607c83d9c037 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:54.405856 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc336513-d3e2-4ad7-803e-204506adf410 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:54.544710 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82961f2-0332-441e-9aea-5a703307dbd0 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:54.580300 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:54.589808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83b1a-322c-4a88-b5d5-b16f21ebc6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:54.590426 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83b1a-322c-4a88-b5d5-b16f21ebc6e5 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:54.590708 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83b1a-322c-4a88-b5d5-b16f21ebc6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:54.590982 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e83b1a-322c-4a88-b5d5-b16f21ebc6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:54.591651 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83b1a-322c-4a88-b5d5-b16f21ebc6e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:54.591985 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83b1a-322c-4a88-b5d5-b16f21ebc6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:54.593377 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e83b1a-322c-4a88-b5d5-b16f21ebc6e5 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:54.619183 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 65/129] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:06:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:54.622741 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83b1a-322c-4a88-b5d5-b16f21ebc6e5 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:54.628917 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc336513-d3e2-4ad7-803e-204506adf410 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:54.637627 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:54.717127 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c5169-8aaf-4a5f-a570-2ecd76dcbd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:54.717803 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c5169-8aaf-4a5f-a570-2ecd76dcbd17 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:54.718055 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c5169-8aaf-4a5f-a570-2ecd76dcbd17 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:54.718329 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c5169-8aaf-4a5f-a570-2ecd76dcbd17 None admin] PATH_INFO: `/v3/users/5e19a867e25a4fc5bdd3ddce61a40937` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:54.724496 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c5169-8aaf-4a5f-a570-2ecd76dcbd17 None admin] RBAC: Authorizing `identity:get_user(user_id=5e19a867e25a4fc5bdd3ddce61a40937)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:54.725965 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c5169-8aaf-4a5f-a570-2ecd76dcbd17 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:54.727780 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 65/130] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:54 2022] GET /identity/v3/users/5e19a867e25a4fc5bdd3ddce61a40937 => generated 275 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:54.732338 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c5169-8aaf-4a5f-a570-2ecd76dcbd17 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:54.770578 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e83b1a-322c-4a88-b5d5-b16f21ebc6e5 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:54.869266 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c5169-8aaf-4a5f-a570-2ecd76dcbd17 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:54.900872 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e6dd9-4302-4ff1-b5f3-d30cbd97d1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:54.901629 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e6dd9-4302-4ff1-b5f3-d30cbd97d1ca None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:54.901919 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e6dd9-4302-4ff1-b5f3-d30cbd97d1ca None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:54.902197 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e6dd9-4302-4ff1-b5f3-d30cbd97d1ca None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:54.905581 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f865b9a-65f3-4bc7-94bb-1ab3b678e4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:54.906333 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f865b9a-65f3-4bc7-94bb-1ab3b678e4ea None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:54.906680 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f865b9a-65f3-4bc7-94bb-1ab3b678e4ea None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:54.907028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f865b9a-65f3-4bc7-94bb-1ab3b678e4ea None admin] PATH_INFO: `/v3/users/5e19a867e25a4fc5bdd3ddce61a40937` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:54.908367 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f865b9a-65f3-4bc7-94bb-1ab3b678e4ea None admin] RBAC: Authorizing `identity:get_user(user_id=5e19a867e25a4fc5bdd3ddce61a40937)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:54.908709 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e6dd9-4302-4ff1-b5f3-d30cbd97d1ca None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:54.909998 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f865b9a-65f3-4bc7-94bb-1ab3b678e4ea None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:54.910219 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e6dd9-4302-4ff1-b5f3-d30cbd97d1ca None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:54.911850 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 66/131] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:54 2022] GET /identity/v3/users/5e19a867e25a4fc5bdd3ddce61a40937 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:54.912383 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 66/132] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:06:54 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:54.916689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f865b9a-65f3-4bc7-94bb-1ab3b678e4ea None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:54.920905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e6dd9-4302-4ff1-b5f3-d30cbd97d1ca None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:55.003488 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:55.010739 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:55.080907 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e6dd9-4302-4ff1-b5f3-d30cbd97d1ca None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:55.110646 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f865b9a-65f3-4bc7-94bb-1ab3b678e4ea None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:55.147994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e06f87-7b8b-42c4-b470-3f1d0b2441b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:55.148550 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06f87-7b8b-42c4-b470-3f1d0b2441b4 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:55.148832 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06f87-7b8b-42c4-b470-3f1d0b2441b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:55.149107 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06f87-7b8b-42c4-b470-3f1d0b2441b4 None admin] PATH_INFO: `/v3/projects/6bf163eed2cc4200a3a41fd92cab643c` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:55.150827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e06f87-7b8b-42c4-b470-3f1d0b2441b4 None admin] RBAC: Authorizing `identity:get_project(project_id=6bf163eed2cc4200a3a41fd92cab643c)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:55.152347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e06f87-7b8b-42c4-b470-3f1d0b2441b4 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:55.153990 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 67/133] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:06:54 2022] GET /identity/v3/projects/6bf163eed2cc4200a3a41fd92cab643c => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:55.154750 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e06f87-7b8b-42c4-b470-3f1d0b2441b4 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:55.172657 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac797d-b118-47f3-9109-68d127626288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:55.173320 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac797d-b118-47f3-9109-68d127626288 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:55.173614 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac797d-b118-47f3-9109-68d127626288 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:55.174217 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac797d-b118-47f3-9109-68d127626288 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:55.176401 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac797d-b118-47f3-9109-68d127626288 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:55.177327 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac797d-b118-47f3-9109-68d127626288 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:55.179945 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 67/134] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:06:54 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:55.181621 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c62b25-df51-4b52-b2f3-2b63d5aecee1 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:55.181906 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c62b25-df51-4b52-b2f3-2b63d5aecee1 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:55.182248 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c62b25-df51-4b52-b2f3-2b63d5aecee1 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:55.183633 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 68/135] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:55.188751 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c62b25-df51-4b52-b2f3-2b63d5aecee1 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:55.290564 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e06f87-7b8b-42c4-b470-3f1d0b2441b4 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:55.318441 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:55.328948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7b335-0b4f-477b-a5c0-e0ca2935e172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:55.329835 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7b335-0b4f-477b-a5c0-e0ca2935e172 None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:55.330157 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c62b25-df51-4b52-b2f3-2b63d5aecee1 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:55.330781 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7b335-0b4f-477b-a5c0-e0ca2935e172 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:55.331213 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7b335-0b4f-477b-a5c0-e0ca2935e172 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d/users/88d08af5e2704454a689607c83d9c037/roles/81a7cb1c95fd45708dbee5e4dc91626b` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:55.334057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7b335-0b4f-477b-a5c0-e0ca2935e172 None admin] RBAC: Authorizing `identity:create_grant(project_id=f40ec939fdcc422995f7ce0c3973152d, user_id=88d08af5e2704454a689607c83d9c037, role_id=81a7cb1c95fd45708dbee5e4dc91626b)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:55.335666 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7b335-0b4f-477b-a5c0-e0ca2935e172 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:55.338786 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:55.355515 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 68/136] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:06:55 2022] PUT /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d/users/88d08af5e2704454a689607c83d9c037/roles/81a7cb1c95fd45708dbee5e4dc91626b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:06:55.357340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7b335-0b4f-477b-a5c0-e0ca2935e172 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:55.373636 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e35b43-e85a-4d32-b62d-d3383b888838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:55.374121 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35b43-e85a-4d32-b62d-d3383b888838 None admin] REQUEST_METHOD: `PUT` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:55.374405 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35b43-e85a-4d32-b62d-d3383b888838 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:55.374680 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e35b43-e85a-4d32-b62d-d3383b888838 None admin] PATH_INFO: `/v3/projects/6bf163eed2cc4200a3a41fd92cab643c/users/5e19a867e25a4fc5bdd3ddce61a40937/roles/57d5f513f8fd4d7dbd1ef0ecc319892e` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:55.376704 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35b43-e85a-4d32-b62d-d3383b888838 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bf163eed2cc4200a3a41fd92cab643c, user_id=5e19a867e25a4fc5bdd3ddce61a40937, role_id=57d5f513f8fd4d7dbd1ef0ecc319892e)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:55.378187 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e35b43-e85a-4d32-b62d-d3383b888838 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:55.407342 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 69/137] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:06:55 2022] PUT /identity/v3/projects/6bf163eed2cc4200a3a41fd92cab643c/users/5e19a867e25a4fc5bdd3ddce61a40937/roles/57d5f513f8fd4d7dbd1ef0ecc319892e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:06:55.412872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012edf3-54cd-4536-b0a7-3c8767461f88 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:55.413218 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012edf3-54cd-4536-b0a7-3c8767461f88 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:55.413501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012edf3-54cd-4536-b0a7-3c8767461f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:55.450202 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-1012edf3-54cd-4536-b0a7-3c8767461f88 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:55.451435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-1012edf3-54cd-4536-b0a7-3c8767461f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:55.501440 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7b335-0b4f-477b-a5c0-e0ca2935e172 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:55.547934 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01758eb0-c38f-4106-92a7-93be8ae86f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:55.549074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01758eb0-c38f-4106-92a7-93be8ae86f47 None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:55.549582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01758eb0-c38f-4106-92a7-93be8ae86f47 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:55.550066 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01758eb0-c38f-4106-92a7-93be8ae86f47 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d/users/5e19a867e25a4fc5bdd3ddce61a40937/roles/035d7eb5fa4e47919e159810a449df68` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:55.554376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01758eb0-c38f-4106-92a7-93be8ae86f47 None admin] RBAC: Authorizing `identity:create_grant(project_id=f40ec939fdcc422995f7ce0c3973152d, user_id=5e19a867e25a4fc5bdd3ddce61a40937, role_id=035d7eb5fa4e47919e159810a449df68)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:55.557304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01758eb0-c38f-4106-92a7-93be8ae86f47 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:55.577859 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 69/138] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:06:55 2022] PUT /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d/users/5e19a867e25a4fc5bdd3ddce61a40937/roles/035d7eb5fa4e47919e159810a449df68 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:06:55.593798 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 70/139] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:55.988774 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01758eb0-c38f-4106-92a7-93be8ae86f47 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:56.056551 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:56.119070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01758eb0-c38f-4106-92a7-93be8ae86f47 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:56.156517 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c4959-acbb-4d63-b211-2195625070f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:56.157516 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c4959-acbb-4d63-b211-2195625070f5 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:56.158001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c4959-acbb-4d63-b211-2195625070f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:56.158486 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c4959-acbb-4d63-b211-2195625070f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:56.159823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c4959-acbb-4d63-b211-2195625070f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:56.161533 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c4959-acbb-4d63-b211-2195625070f5 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:56.163375 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 70/140] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:06:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:56.169858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012edf3-54cd-4536-b0a7-3c8767461f88 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:56.294951 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:56.301191 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012edf3-54cd-4536-b0a7-3c8767461f88 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:56.349221 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c9e25-9a97-45e0-803e-526a54b3a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:56.349843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c9e25-9a97-45e0-803e-526a54b3a55a None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:56.350107 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c9e25-9a97-45e0-803e-526a54b3a55a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:56.350384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c9e25-9a97-45e0-803e-526a54b3a55a None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:56.351040 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c9e25-9a97-45e0-803e-526a54b3a55a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:56.352598 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c9e25-9a97-45e0-803e-526a54b3a55a None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:56.384160 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 71/141] 10.222.0.58 () {60 vars in 1132 bytes} [Tue Aug 23 22:06:56 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:06:56.864132 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d5e84-0c2c-4c9c-934d-f01aca045564 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:56.865174 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d5e84-0c2c-4c9c-934d-f01aca045564 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:56.865669 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d5e84-0c2c-4c9c-934d-f01aca045564 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:56.867202 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 71/142] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:56.873957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718c27-d238-4d9e-a8b3-a514dc1829d1 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:56.874516 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718c27-d238-4d9e-a8b3-a514dc1829d1 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:56.874998 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718c27-d238-4d9e-a8b3-a514dc1829d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:56.899000 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-07718c27-d238-4d9e-a8b3-a514dc1829d1 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:56.901154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-07718c27-d238-4d9e-a8b3-a514dc1829d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:56.985773 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 72/143] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:57.070526 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73088c5-b66f-4e30-b803-3e679f805bd9 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:57.071173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73088c5-b66f-4e30-b803-3e679f805bd9 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:57.072274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73088c5-b66f-4e30-b803-3e679f805bd9 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:57.073879 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 72/144] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:57.079679 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb903f22-fc6b-4be5-821d-7e5ee412bcba None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:57.080233 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb903f22-fc6b-4be5-821d-7e5ee412bcba None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:57.080725 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb903f22-fc6b-4be5-821d-7e5ee412bcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:57.100924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-fb903f22-fc6b-4be5-821d-7e5ee412bcba None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:57.102525 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-fb903f22-fc6b-4be5-821d-7e5ee412bcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:57.177515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 73/145] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:57.604114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73088c5-b66f-4e30-b803-3e679f805bd9 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:57.741471 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73088c5-b66f-4e30-b803-3e679f805bd9 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:57.764296 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:57.769866 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb903f22-fc6b-4be5-821d-7e5ee412bcba None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:57.800204 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:57.820852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a431-ebb5-4197-bf71-37f6d730ed06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:57.822124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a431-ebb5-4197-bf71-37f6d730ed06 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:57.822409 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a431-ebb5-4197-bf71-37f6d730ed06 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:57.822687 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a431-ebb5-4197-bf71-37f6d730ed06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:57.850922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34a431-ebb5-4197-bf71-37f6d730ed06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-da34a431-ebb5-4197-bf71-37f6d730ed06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:57.860668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:57.861555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:06:57.862320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 73/146] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:06:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:57.869954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a431-ebb5-4197-bf71-37f6d730ed06 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:57.950672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb903f22-fc6b-4be5-821d-7e5ee412bcba None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:57.995530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a431-ebb5-4197-bf71-37f6d730ed06 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:58.004547 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df1a7f-0f13-462a-8c52-1f9172bd23e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:58.005443 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df1a7f-0f13-462a-8c52-1f9172bd23e4 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:58.005862 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df1a7f-0f13-462a-8c52-1f9172bd23e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:58.006318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df1a7f-0f13-462a-8c52-1f9172bd23e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:58.027214 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df1a7f-0f13-462a-8c52-1f9172bd23e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-98df1a7f-0f13-462a-8c52-1f9172bd23e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:58.032447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:58.033493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:06:58.034369 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 74/147] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:06:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:58.038132 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1890ec0-1185-4531-a77c-fd7be5f72fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:58.038910 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1890ec0-1185-4531-a77c-fd7be5f72fa7 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:58.039218 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df1a7f-0f13-462a-8c52-1f9172bd23e4 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:58.039557 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1890ec0-1185-4531-a77c-fd7be5f72fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:58.040084 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1890ec0-1185-4531-a77c-fd7be5f72fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:58.041814 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1890ec0-1185-4531-a77c-fd7be5f72fa7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:58.042276 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1890ec0-1185-4531-a77c-fd7be5f72fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:58.043898 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1890ec0-1185-4531-a77c-fd7be5f72fa7 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:58.053185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 74/148] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:06:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:58.059935 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1890ec0-1185-4531-a77c-fd7be5f72fa7 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:58.107425 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:58.157478 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:58.189693 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1890ec0-1185-4531-a77c-fd7be5f72fa7 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:58.203100 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df1a7f-0f13-462a-8c52-1f9172bd23e4 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:58.230842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec099a1-2950-4cbc-9921-f31b43a263a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:58.231768 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec099a1-2950-4cbc-9921-f31b43a263a3 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:58.232403 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec099a1-2950-4cbc-9921-f31b43a263a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:58.232814 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec099a1-2950-4cbc-9921-f31b43a263a3 None admin] PATH_INFO: `/v3/users/4bfc1715f2aa4c458f0171797050897a` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:58.234903 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec099a1-2950-4cbc-9921-f31b43a263a3 None admin] RBAC: Authorizing `identity:get_user(user_id=4bfc1715f2aa4c458f0171797050897a)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:58.240125 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec099a1-2950-4cbc-9921-f31b43a263a3 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:58.240125 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 75/149] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:58 2022] GET /identity/v3/users/4bfc1715f2aa4c458f0171797050897a => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:58.246962 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec099a1-2950-4cbc-9921-f31b43a263a3 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:58.252941 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3f52-5c45-4e2f-be88-d067bbbd95b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:58.253575 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3f52-5c45-4e2f-be88-d067bbbd95b8 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:58.253856 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3f52-5c45-4e2f-be88-d067bbbd95b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:58.254124 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3f52-5c45-4e2f-be88-d067bbbd95b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:58.254799 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3f52-5c45-4e2f-be88-d067bbbd95b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:58.255102 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3f52-5c45-4e2f-be88-d067bbbd95b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:58.256552 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3f52-5c45-4e2f-be88-d067bbbd95b8 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:58.272309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 75/150] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:06:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:58.273802 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3f52-5c45-4e2f-be88-d067bbbd95b8 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:58.380170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec099a1-2950-4cbc-9921-f31b43a263a3 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:58.390149 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3f52-5c45-4e2f-be88-d067bbbd95b8 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:58.390809 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:58.421839 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fd1d2-f674-4b76-ac19-b15cb349e40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:58.422466 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fd1d2-f674-4b76-ac19-b15cb349e40e None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:58.422803 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fd1d2-f674-4b76-ac19-b15cb349e40e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:58.423083 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fd1d2-f674-4b76-ac19-b15cb349e40e None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:58.424316 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fd1d2-f674-4b76-ac19-b15cb349e40e None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:58.425767 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fd1d2-f674-4b76-ac19-b15cb349e40e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:58.426589 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1592b-f1dc-49e7-8811-ac628b08add4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:58.427225 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1592b-f1dc-49e7-8811-ac628b08add4 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:58.427665 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1592b-f1dc-49e7-8811-ac628b08add4 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:58.427781 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 76/151] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:06:58 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:58.427874 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1592b-f1dc-49e7-8811-ac628b08add4 None admin] PATH_INFO: `/v3/users/5e19a867e25a4fc5bdd3ddce61a40937` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:58.428930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1592b-f1dc-49e7-8811-ac628b08add4 None admin] RBAC: Authorizing `identity:get_user(user_id=5e19a867e25a4fc5bdd3ddce61a40937)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:58.430371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf1592b-f1dc-49e7-8811-ac628b08add4 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:58.433050 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 76/152] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:06:58 2022] GET /identity/v3/users/5e19a867e25a4fc5bdd3ddce61a40937 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:06:58.434098 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fd1d2-f674-4b76-ac19-b15cb349e40e None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:58.438607 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1592b-f1dc-49e7-8811-ac628b08add4 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:58.441453 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:58.570813 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fd1d2-f674-4b76-ac19-b15cb349e40e None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:58.571432 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf1592b-f1dc-49e7-8811-ac628b08add4 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:58.614788 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f957f7-0bbc-470f-b39f-03c589b897cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:58.615458 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f957f7-0bbc-470f-b39f-03c589b897cf None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:58.615740 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f957f7-0bbc-470f-b39f-03c589b897cf None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:58.616038 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f957f7-0bbc-470f-b39f-03c589b897cf None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d/users/4bfc1715f2aa4c458f0171797050897a/roles/eefe4f9f49e4401a929ce82b866421d7` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:58.619481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f957f7-0bbc-470f-b39f-03c589b897cf None admin] RBAC: Authorizing `identity:create_grant(project_id=f40ec939fdcc422995f7ce0c3973152d, user_id=4bfc1715f2aa4c458f0171797050897a, role_id=eefe4f9f49e4401a929ce82b866421d7)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:58.621898 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f957f7-0bbc-470f-b39f-03c589b897cf None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:58.633467 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dae859-9bf5-4867-82ed-a1946ccf6469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:58.634811 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dae859-9bf5-4867-82ed-a1946ccf6469 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:58.635141 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dae859-9bf5-4867-82ed-a1946ccf6469 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:58.635418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dae859-9bf5-4867-82ed-a1946ccf6469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:58.644823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 77/153] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:06:58 2022] PUT /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d/users/4bfc1715f2aa4c458f0171797050897a/roles/eefe4f9f49e4401a929ce82b866421d7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:06:58.646063 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ee4c6-bf4f-4f58-bafa-1f609d05eddf None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:58.646352 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ee4c6-bf4f-4f58-bafa-1f609d05eddf None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:58.646626 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ee4c6-bf4f-4f58-bafa-1f609d05eddf None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:58.652251 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 78/154] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:06:58.658722 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d41437-3a12-4ecb-b143-86aae152a904 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:58.659026 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d41437-3a12-4ecb-b143-86aae152a904 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:58.659276 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d41437-3a12-4ecb-b143-86aae152a904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:58.688891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-c1d41437-3a12-4ecb-b143-86aae152a904 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:06:58.690106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-c1d41437-3a12-4ecb-b143-86aae152a904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:06:58.728453 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dae859-9bf5-4867-82ed-a1946ccf6469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:58.730378 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dae859-9bf5-4867-82ed-a1946ccf6469 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:58.733212 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:58.741703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:58.839769 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 79/155] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:06:58.872703 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 77/156] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:06:58.878447 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d41437-3a12-4ecb-b143-86aae152a904 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:58.986429 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d41437-3a12-4ecb-b143-86aae152a904 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:59.022438 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36a62a-bc2c-4a20-b46e-404bbacd1993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:59.023069 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36a62a-bc2c-4a20-b46e-404bbacd1993 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:59.023347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36a62a-bc2c-4a20-b46e-404bbacd1993 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:59.023618 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36a62a-bc2c-4a20-b46e-404bbacd1993 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:59.025411 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36a62a-bc2c-4a20-b46e-404bbacd1993 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:59.026867 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36a62a-bc2c-4a20-b46e-404bbacd1993 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:59.028825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 80/157] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:06:58 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:59.034612 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dae859-9bf5-4867-82ed-a1946ccf6469 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:59.142970 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dae859-9bf5-4867-82ed-a1946ccf6469 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:59.144576 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:59.182288 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64aa362-fb3b-4df4-8221-7913f69c0c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:59.182903 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aa362-fb3b-4df4-8221-7913f69c0c7e None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:59.183219 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aa362-fb3b-4df4-8221-7913f69c0c7e None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:59.183440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64aa362-fb3b-4df4-8221-7913f69c0c7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:59.184200 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64aa362-fb3b-4df4-8221-7913f69c0c7e None admin] RBAC: Adding query filter params (role.id=57d5f513f8fd4d7dbd1ef0ecc319892e, scope.project.id=f40ec939fdcc422995f7ce0c3973152d, user.id=5e19a867e25a4fc5bdd3ddce61a40937) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:06:59.184503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64aa362-fb3b-4df4-8221-7913f69c0c7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:06:59.185959 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64aa362-fb3b-4df4-8221-7913f69c0c7e None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:06:59.192663 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 78/158] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:06:59 2022] GET /identity/v3/role_assignments?user.id=5e19a867e25a4fc5bdd3ddce61a40937&scope.project.id=f40ec939fdcc422995f7ce0c3973152d&role.id=57d5f513f8fd4d7dbd1ef0ecc319892e => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:06:59.646109 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36a62a-bc2c-4a20-b46e-404bbacd1993 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:59.688775 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:06:59.786921 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36a62a-bc2c-4a20-b46e-404bbacd1993 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:06:59.832761 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b614ffa-3001-4715-8850-21cc1f4042fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:06:59.833848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b614ffa-3001-4715-8850-21cc1f4042fa None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:59.834324 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b614ffa-3001-4715-8850-21cc1f4042fa None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:59.834817 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b614ffa-3001-4715-8850-21cc1f4042fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:59.854703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b614ffa-3001-4715-8850-21cc1f4042fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-1b614ffa-3001-4715-8850-21cc1f4042fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:06:59.861092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:06:59.862019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:06:59.862830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:06:59.862830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:06:59.862830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:06:59.862830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:06:59.862830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:06:59.862830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:06:59.862830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:06:59.862830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:06:59.862830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:06:59.862830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:06:59.862830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:06:59.862830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:06:59.865189 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 81/159] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:06:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:06:59.871898 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64aa362-fb3b-4df4-8221-7913f69c0c7e None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:06:59.958426 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd39559-52ec-4864-991a-4b753d14a530 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:59.959491 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd39559-52ec-4864-991a-4b753d14a530 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:59.959991 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd39559-52ec-4864-991a-4b753d14a530 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:06:59.961521 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 82/160] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:06:59.967550 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b6bbe-7df4-459a-b2a0-3f0473edc69e None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:06:59.967851 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b6bbe-7df4-459a-b2a0-3f0473edc69e None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:06:59.968126 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b6bbe-7df4-459a-b2a0-3f0473edc69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:00.000822 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64aa362-fb3b-4df4-8221-7913f69c0c7e None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:00.005384 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-024b6bbe-7df4-459a-b2a0-3f0473edc69e None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:00.006582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-024b6bbe-7df4-459a-b2a0-3f0473edc69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:00.045586 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec648a1-5a5d-4102-a97c-a86cb1b17458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:00.046452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec648a1-5a5d-4102-a97c-a86cb1b17458 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:00.046733 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec648a1-5a5d-4102-a97c-a86cb1b17458 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:00.047006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec648a1-5a5d-4102-a97c-a86cb1b17458 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:00.047672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec648a1-5a5d-4102-a97c-a86cb1b17458 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:00.048037 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec648a1-5a5d-4102-a97c-a86cb1b17458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:00.049430 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec648a1-5a5d-4102-a97c-a86cb1b17458 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:00.070133 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 79/161] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:06:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:00.076480 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec648a1-5a5d-4102-a97c-a86cb1b17458 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:00.126942 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:00.143757 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 83/162] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:00.145038 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c202ead-c3bf-4c70-bb29-72f40d91b0b0 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:00.145321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c202ead-c3bf-4c70-bb29-72f40d91b0b0 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:00.145592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c202ead-c3bf-4c70-bb29-72f40d91b0b0 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:00.146800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 84/163] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:00.198215 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210487-b2a9-42fc-9296-df2273fdd780 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:00.198515 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210487-b2a9-42fc-9296-df2273fdd780 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:00.198773 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210487-b2a9-42fc-9296-df2273fdd780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:00.239037 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-3f210487-b2a9-42fc-9296-df2273fdd780 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:00.244433 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-3f210487-b2a9-42fc-9296-df2273fdd780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:00.251957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec648a1-5a5d-4102-a97c-a86cb1b17458 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:00.272044 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:00.309537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59465eb-d062-4562-99fb-3722055e4b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:00.310183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59465eb-d062-4562-99fb-3722055e4b5b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:00.310464 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59465eb-d062-4562-99fb-3722055e4b5b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:00.310745 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59465eb-d062-4562-99fb-3722055e4b5b None admin] PATH_INFO: `/v3/users/5e19a867e25a4fc5bdd3ddce61a40937` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:00.316536 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59465eb-d062-4562-99fb-3722055e4b5b None admin] RBAC: Authorizing `identity:get_user(user_id=5e19a867e25a4fc5bdd3ddce61a40937)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:00.318010 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59465eb-d062-4562-99fb-3722055e4b5b None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:00.319994 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 80/164] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:00 2022] GET /identity/v3/users/5e19a867e25a4fc5bdd3ddce61a40937 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:00.326170 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59465eb-d062-4562-99fb-3722055e4b5b None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:00.337585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 85/165] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:00.486330 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:00.498071 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59465eb-d062-4562-99fb-3722055e4b5b None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:00.540416 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16b7b7-4b7d-4be7-bfbe-839d0e73e971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:00.541042 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16b7b7-4b7d-4be7-bfbe-839d0e73e971 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:00.541328 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16b7b7-4b7d-4be7-bfbe-839d0e73e971 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:00.541594 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16b7b7-4b7d-4be7-bfbe-839d0e73e971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:00.616002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16b7b7-4b7d-4be7-bfbe-839d0e73e971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:00.617503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16b7b7-4b7d-4be7-bfbe-839d0e73e971 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:00.735446 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:00.740145 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 81/166] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:07:00.745869 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f210487-b2a9-42fc-9296-df2273fdd780 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:00.752535 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16b7b7-4b7d-4be7-bfbe-839d0e73e971 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:00.882440 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f210487-b2a9-42fc-9296-df2273fdd780 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:00.933513 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16b7b7-4b7d-4be7-bfbe-839d0e73e971 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:00.951669 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51099292-f0f3-427c-8bef-839afcfd33a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:00.952705 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51099292-f0f3-427c-8bef-839afcfd33a0 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:00.954241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51099292-f0f3-427c-8bef-839afcfd33a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:00.954877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51099292-f0f3-427c-8bef-839afcfd33a0 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:00.956470 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51099292-f0f3-427c-8bef-839afcfd33a0 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:00.958797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51099292-f0f3-427c-8bef-839afcfd33a0 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:00.961249 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 86/167] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:00 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:00.968723 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51099292-f0f3-427c-8bef-839afcfd33a0 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:00.996360 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:01.032543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848dbca-39d8-4da4-a8b0-6cd1b9c11a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:01.033240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848dbca-39d8-4da4-a8b0-6cd1b9c11a81 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:01.033459 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848dbca-39d8-4da4-a8b0-6cd1b9c11a81 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:01.033748 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848dbca-39d8-4da4-a8b0-6cd1b9c11a81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:01.072826 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848dbca-39d8-4da4-a8b0-6cd1b9c11a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-7848dbca-39d8-4da4-a8b0-6cd1b9c11a81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:01.077611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:01.078672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:01.079475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 82/168] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:01.088760 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51099292-f0f3-427c-8bef-839afcfd33a0 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:01.107026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848dbca-39d8-4da4-a8b0-6cd1b9c11a81 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:01.128762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53b620-77e5-4056-a478-3076c2ccf6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:01.129337 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53b620-77e5-4056-a478-3076c2ccf6c1 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:01.129619 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53b620-77e5-4056-a478-3076c2ccf6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:01.129888 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53b620-77e5-4056-a478-3076c2ccf6c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:01.130902 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53b620-77e5-4056-a478-3076c2ccf6c1 None admin] RBAC: Adding query filter params (role.id=035d7eb5fa4e47919e159810a449df68, scope.project.id=f40ec939fdcc422995f7ce0c3973152d, user.id=5e19a867e25a4fc5bdd3ddce61a40937) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:01.130902 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53b620-77e5-4056-a478-3076c2ccf6c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:01.132380 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53b620-77e5-4056-a478-3076c2ccf6c1 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:01.139502 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 87/169] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:00 2022] GET /identity/v3/role_assignments?user.id=5e19a867e25a4fc5bdd3ddce61a40937&scope.project.id=f40ec939fdcc422995f7ce0c3973152d&role.id=035d7eb5fa4e47919e159810a449df68 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:01.140219 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53b620-77e5-4056-a478-3076c2ccf6c1 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:01.185050 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:01.256426 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848dbca-39d8-4da4-a8b0-6cd1b9c11a81 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:01.319175 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7997e10-e632-48a7-a83b-a078f5804b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:01.320205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7997e10-e632-48a7-a83b-a078f5804b9a None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:01.321605 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7997e10-e632-48a7-a83b-a078f5804b9a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:01.322107 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7997e10-e632-48a7-a83b-a078f5804b9a None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:01.323082 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7997e10-e632-48a7-a83b-a078f5804b9a None admin] RBAC: Adding query filter params (name=member) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:01.323584 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7997e10-e632-48a7-a83b-a078f5804b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:01.325238 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7997e10-e632-48a7-a83b-a078f5804b9a None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:01.341363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 83/170] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:01.347818 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7997e10-e632-48a7-a83b-a078f5804b9a None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:01.481726 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:01.523419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53b620-77e5-4056-a478-3076c2ccf6c1 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:01.575152 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7997e10-e632-48a7-a83b-a078f5804b9a None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:01.608781 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a0bce-e732-4e33-8259-6992aaa09eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:01.609427 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a0bce-e732-4e33-8259-6992aaa09eca None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:01.609701 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a0bce-e732-4e33-8259-6992aaa09eca None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:01.609968 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a0bce-e732-4e33-8259-6992aaa09eca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:01.616227 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:01.642508 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a0bce-e732-4e33-8259-6992aaa09eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-6f7a0bce-e732-4e33-8259-6992aaa09eca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:01.647252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:01.648130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:01.648996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:01.648996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:01.648996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:01.648996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:01.648996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:01.648996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:01.648996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:01.648996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:01.648996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:01.648996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:01.648996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:01.648996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:01.650896 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 88/171] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 511 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:01.656801 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a0bce-e732-4e33-8259-6992aaa09eca None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:01.661799 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f334b7-c5da-43c7-8d4f-1edf431bf8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:01.662446 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f334b7-c5da-43c7-8d4f-1edf431bf8c7 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:01.662724 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f334b7-c5da-43c7-8d4f-1edf431bf8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:01.662996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f334b7-c5da-43c7-8d4f-1edf431bf8c7 None admin] PATH_INFO: `/v3/users/5e19a867e25a4fc5bdd3ddce61a40937` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:01.665466 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f334b7-c5da-43c7-8d4f-1edf431bf8c7 None admin] RBAC: Authorizing `identity:get_user(user_id=5e19a867e25a4fc5bdd3ddce61a40937)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:01.667162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f334b7-c5da-43c7-8d4f-1edf431bf8c7 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:01.668759 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 84/172] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:01 2022] GET /identity/v3/users/5e19a867e25a4fc5bdd3ddce61a40937 => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:01.679586 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f334b7-c5da-43c7-8d4f-1edf431bf8c7 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:01.845525 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f334b7-c5da-43c7-8d4f-1edf431bf8c7 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:01.846022 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a0bce-e732-4e33-8259-6992aaa09eca None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:01.889148 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639add5-2da8-4071-9d40-2999afec5203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:01.889841 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639add5-2da8-4071-9d40-2999afec5203 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:01.890131 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639add5-2da8-4071-9d40-2999afec5203 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:01.890405 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639add5-2da8-4071-9d40-2999afec5203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:01.933203 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8afa18-6bf1-456e-a7e8-7968d266a417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:01.933826 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8afa18-6bf1-456e-a7e8-7968d266a417 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:01.934106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8afa18-6bf1-456e-a7e8-7968d266a417 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:01.934379 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8afa18-6bf1-456e-a7e8-7968d266a417 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:01.935052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8afa18-6bf1-456e-a7e8-7968d266a417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:01.935354 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8afa18-6bf1-456e-a7e8-7968d266a417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:01.936796 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8afa18-6bf1-456e-a7e8-7968d266a417 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:01.955095 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 89/173] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:01.956432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3967-6f34-48a4-9030-8422daa4a514 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:01.956707 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:01.956814 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3967-6f34-48a4-9030-8422daa4a514 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:01.957059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3967-6f34-48a4-9030-8422daa4a514 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:01.958269 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 90/174] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:01.963666 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3967-6f34-48a4-9030-8422daa4a514 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:01.979611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639add5-2da8-4071-9d40-2999afec5203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:01.981137 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639add5-2da8-4071-9d40-2999afec5203 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:01.982211 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:02.111623 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 85/175] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:02.113000 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c40da7-b527-4e6e-91f8-9ff8aff20a77 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.113603 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c40da7-b527-4e6e-91f8-9ff8aff20a77 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.113887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c40da7-b527-4e6e-91f8-9ff8aff20a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.137662 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-12c40da7-b527-4e6e-91f8-9ff8aff20a77 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:02.138877 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-12c40da7-b527-4e6e-91f8-9ff8aff20a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:02.225401 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 86/176] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:02.226390 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c40da7-b527-4e6e-91f8-9ff8aff20a77 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:02.229072 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3967-6f34-48a4-9030-8422daa4a514 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:02.264058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:02.313935 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6e7d9-859a-4ce8-ae0a-6bb01ee14920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:02.314579 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6e7d9-859a-4ce8-ae0a-6bb01ee14920 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.314861 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6e7d9-859a-4ce8-ae0a-6bb01ee14920 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.315133 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6e7d9-859a-4ce8-ae0a-6bb01ee14920 None admin] PATH_INFO: `/v3/users/88d08af5e2704454a689607c83d9c037` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.320527 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6e7d9-859a-4ce8-ae0a-6bb01ee14920 None admin] RBAC: Authorizing `identity:get_user(user_id=88d08af5e2704454a689607c83d9c037)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:02.322049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6e7d9-859a-4ce8-ae0a-6bb01ee14920 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:02.324065 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 91/177] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:01 2022] GET /identity/v3/users/88d08af5e2704454a689607c83d9c037 => generated 247 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:02.325268 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40a6e-a405-4d23-8a44-030959113ae0 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.325557 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40a6e-a405-4d23-8a44-030959113ae0 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.325830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b40a6e-a405-4d23-8a44-030959113ae0 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.327162 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 92/178] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:02.329259 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b40a6e-a405-4d23-8a44-030959113ae0 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:02.359217 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c40da7-b527-4e6e-91f8-9ff8aff20a77 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:02.400656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683032f-f474-4507-b5c0-9645e44ac4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:02.401215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683032f-f474-4507-b5c0-9645e44ac4d9 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.401499 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683032f-f474-4507-b5c0-9645e44ac4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.401777 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683032f-f474-4507-b5c0-9645e44ac4d9 None admin] PATH_INFO: `/v3/projects/6bf163eed2cc4200a3a41fd92cab643c` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.403059 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683032f-f474-4507-b5c0-9645e44ac4d9 None admin] RBAC: Authorizing `identity:get_project(project_id=6bf163eed2cc4200a3a41fd92cab643c)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:02.404692 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683032f-f474-4507-b5c0-9645e44ac4d9 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:02.406538 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 87/179] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:02 2022] GET /identity/v3/projects/6bf163eed2cc4200a3a41fd92cab643c => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:02.407658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdad159-0be8-434e-8cdc-f009a4f3efb4 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.407965 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdad159-0be8-434e-8cdc-f009a4f3efb4 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.408241 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdad159-0be8-434e-8cdc-f009a4f3efb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.427498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-6fdad159-0be8-434e-8cdc-f009a4f3efb4 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:02.428815 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-6fdad159-0be8-434e-8cdc-f009a4f3efb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:02.445076 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:02.479810 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b40a6e-a405-4d23-8a44-030959113ae0 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:02.509368 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 88/180] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:02.510622 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13149ea4-16b9-4f0d-ad60-64bcec701cdc None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.510912 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13149ea4-16b9-4f0d-ad60-64bcec701cdc None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.511186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13149ea4-16b9-4f0d-ad60-64bcec701cdc None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.512469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 89/181] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:02.513147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13149ea4-16b9-4f0d-ad60-64bcec701cdc None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:02.529012 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2045c-7f59-4a84-9d9c-abacbd229fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:02.529687 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2045c-7f59-4a84-9d9c-abacbd229fa5 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.529969 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2045c-7f59-4a84-9d9c-abacbd229fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.530686 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2045c-7f59-4a84-9d9c-abacbd229fa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.534535 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:02.622968 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2045c-7f59-4a84-9d9c-abacbd229fa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:02.624570 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2045c-7f59-4a84-9d9c-abacbd229fa5 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:02.632959 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13149ea4-16b9-4f0d-ad60-64bcec701cdc None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:02.676025 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2295ce6-8a25-406e-994e-417d9df919db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:02.676631 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295ce6-8a25-406e-994e-417d9df919db None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.676975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295ce6-8a25-406e-994e-417d9df919db None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.677285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295ce6-8a25-406e-994e-417d9df919db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.677980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2295ce6-8a25-406e-994e-417d9df919db None admin] RBAC: Adding query filter params (role.id=57d5f513f8fd4d7dbd1ef0ecc319892e, scope.project.id=6bf163eed2cc4200a3a41fd92cab643c, user.id=5e19a867e25a4fc5bdd3ddce61a40937) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:02.678312 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2295ce6-8a25-406e-994e-417d9df919db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:02.679759 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2295ce6-8a25-406e-994e-417d9df919db None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:02.687156 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 90/182] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:02 2022] GET /identity/v3/role_assignments?user.id=5e19a867e25a4fc5bdd3ddce61a40937&scope.project.id=6bf163eed2cc4200a3a41fd92cab643c&role.id=57d5f513f8fd4d7dbd1ef0ecc319892e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:02.688824 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c0ebd-2c9f-44ef-a404-3d6078dff8f7 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.689175 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c0ebd-2c9f-44ef-a404-3d6078dff8f7 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.689584 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c0ebd-2c9f-44ef-a404-3d6078dff8f7 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.691722 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 91/183] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:02.693410 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cabab-02cb-45c2-acf9-e347ad3b418f None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.693760 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cabab-02cb-45c2-acf9-e347ad3b418f None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.694360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cabab-02cb-45c2-acf9-e347ad3b418f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.720940 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-190cabab-02cb-45c2-acf9-e347ad3b418f None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:02.722262 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-190cabab-02cb-45c2-acf9-e347ad3b418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:02.723077 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:02.766567 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 93/184] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:02.766567 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2045c-7f59-4a84-9d9c-abacbd229fa5 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:02.835252 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 92/185] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:02.837561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d16ff-e8cd-4b59-b9dd-9d63b5f94e2d None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.838068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d16ff-e8cd-4b59-b9dd-9d63b5f94e2d None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.838536 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d16ff-e8cd-4b59-b9dd-9d63b5f94e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.861947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-0b6d16ff-e8cd-4b59-b9dd-9d63b5f94e2d None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:02.863529 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-0b6d16ff-e8cd-4b59-b9dd-9d63b5f94e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:02.866174 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:02.905227 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2045c-7f59-4a84-9d9c-abacbd229fa5 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:02.945233 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 93/186] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:02.947005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d16ff-e8cd-4b59-b9dd-9d63b5f94e2d None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:02.966364 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16338630-b253-4e21-bb6c-9a037629ed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:02.967022 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16338630-b253-4e21-bb6c-9a037629ed99 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:02.967283 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16338630-b253-4e21-bb6c-9a037629ed99 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:02.967557 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16338630-b253-4e21-bb6c-9a037629ed99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:02.984389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16338630-b253-4e21-bb6c-9a037629ed99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-16338630-b253-4e21-bb6c-9a037629ed99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:02.991272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:02.992171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:02.992989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 94/187] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:02.993818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16338630-b253-4e21-bb6c-9a037629ed99 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.039001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.077196 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d16ff-e8cd-4b59-b9dd-9d63b5f94e2d None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.114782 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea638c-7ca5-4016-9799-a5f83861d6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.117768 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea638c-7ca5-4016-9799-a5f83861d6e7 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.118960 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea638c-7ca5-4016-9799-a5f83861d6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.119429 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea638c-7ca5-4016-9799-a5f83861d6e7 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.120907 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea638c-7ca5-4016-9799-a5f83861d6e7 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.122606 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea638c-7ca5-4016-9799-a5f83861d6e7 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.125169 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 94/188] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:02 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:03.126186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea638c-7ca5-4016-9799-a5f83861d6e7 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.126554 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16338630-b253-4e21-bb6c-9a037629ed99 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.141913 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.171022 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975d5e6-5c21-4d35-b59a-eb2bcc86fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.171665 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975d5e6-5c21-4d35-b59a-eb2bcc86fb70 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.171982 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975d5e6-5c21-4d35-b59a-eb2bcc86fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.172252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975d5e6-5c21-4d35-b59a-eb2bcc86fb70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.186533 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975d5e6-5c21-4d35-b59a-eb2bcc86fb70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-7975d5e6-5c21-4d35-b59a-eb2bcc86fb70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:03.193305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:03.194204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:03.194994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 95/189] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:03.195689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975d5e6-5c21-4d35-b59a-eb2bcc86fb70 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.255588 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea638c-7ca5-4016-9799-a5f83861d6e7 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.295997 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e5f46-f88d-4019-a141-3ce01c4d72c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.296611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e5f46-f88d-4019-a141-3ce01c4d72c7 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.296896 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e5f46-f88d-4019-a141-3ce01c4d72c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.297168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e5f46-f88d-4019-a141-3ce01c4d72c7 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.298267 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e5f46-f88d-4019-a141-3ce01c4d72c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:03.298583 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e5f46-f88d-4019-a141-3ce01c4d72c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.299986 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e5f46-f88d-4019-a141-3ce01c4d72c7 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.303352 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.311473 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 95/190] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:03.311473 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e5f46-f88d-4019-a141-3ce01c4d72c7 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.313303 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975d5e6-5c21-4d35-b59a-eb2bcc86fb70 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.347491 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc8d38-0209-4783-a865-0ea21a2d088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.348118 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc8d38-0209-4783-a865-0ea21a2d088d None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.348400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc8d38-0209-4783-a865-0ea21a2d088d None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.348671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc8d38-0209-4783-a865-0ea21a2d088d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.349390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc8d38-0209-4783-a865-0ea21a2d088d None admin] RBAC: Adding query filter params (role.id=81a7cb1c95fd45708dbee5e4dc91626b, scope.project.id=f40ec939fdcc422995f7ce0c3973152d, user.id=88d08af5e2704454a689607c83d9c037) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:03.349699 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc8d38-0209-4783-a865-0ea21a2d088d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.351157 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc8d38-0209-4783-a865-0ea21a2d088d None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.357019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 96/191] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/role_assignments?user.id=88d08af5e2704454a689607c83d9c037&scope.project.id=f40ec939fdcc422995f7ce0c3973152d&role.id=81a7cb1c95fd45708dbee5e4dc91626b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:03.357019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc8d38-0209-4783-a865-0ea21a2d088d None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.389072 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.428474 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e5f46-f88d-4019-a141-3ce01c4d72c7 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.470655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0612c46-7e53-4b0c-bc53-fd91dc977712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.471221 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0612c46-7e53-4b0c-bc53-fd91dc977712 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.471502 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0612c46-7e53-4b0c-bc53-fd91dc977712 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.471774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0612c46-7e53-4b0c-bc53-fd91dc977712 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.472958 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0612c46-7e53-4b0c-bc53-fd91dc977712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.474434 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0612c46-7e53-4b0c-bc53-fd91dc977712 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.476109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 96/192] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:03.476982 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0612c46-7e53-4b0c-bc53-fd91dc977712 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.487694 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc8d38-0209-4783-a865-0ea21a2d088d None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.533451 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf39604-087d-489b-ab74-6b00c958c526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.534060 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf39604-087d-489b-ab74-6b00c958c526 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.534339 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf39604-087d-489b-ab74-6b00c958c526 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.534617 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf39604-087d-489b-ab74-6b00c958c526 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.535550 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf39604-087d-489b-ab74-6b00c958c526 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:03.535654 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf39604-087d-489b-ab74-6b00c958c526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.537013 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf39604-087d-489b-ab74-6b00c958c526 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.548487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 97/193] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:03.548864 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf39604-087d-489b-ab74-6b00c958c526 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.576823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.609265 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0612c46-7e53-4b0c-bc53-fd91dc977712 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.645283 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f53031-d8c8-4b4d-ac50-b95acf97c30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.645905 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f53031-d8c8-4b4d-ac50-b95acf97c30f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.646182 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f53031-d8c8-4b4d-ac50-b95acf97c30f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.646452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f53031-d8c8-4b4d-ac50-b95acf97c30f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.649693 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.659218 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f53031-d8c8-4b4d-ac50-b95acf97c30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-01f53031-d8c8-4b4d-ac50-b95acf97c30f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:03.664311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:03.665503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 97/194] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:03.666445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f53031-d8c8-4b4d-ac50-b95acf97c30f None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.680421 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf39604-087d-489b-ab74-6b00c958c526 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.719083 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dac5a-0e58-40f9-be28-852c8309f3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.719705 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dac5a-0e58-40f9-be28-852c8309f3b1 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.720275 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dac5a-0e58-40f9-be28-852c8309f3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.720550 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710dac5a-0e58-40f9-be28-852c8309f3b1 None admin] PATH_INFO: `/v3/users/5c8ad19fd0c84f78930e1175d48a7f50` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.733790 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710dac5a-0e58-40f9-be28-852c8309f3b1 None admin] RBAC: Authorizing `identity:get_user(user_id=5c8ad19fd0c84f78930e1175d48a7f50)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.735195 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710dac5a-0e58-40f9-be28-852c8309f3b1 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.736829 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 98/195] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/users/5c8ad19fd0c84f78930e1175d48a7f50 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:03.737593 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dac5a-0e58-40f9-be28-852c8309f3b1 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.769003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f53031-d8c8-4b4d-ac50-b95acf97c30f None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.803177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9a588-6e43-47c5-97eb-f0f297778790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.803788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9a588-6e43-47c5-97eb-f0f297778790 None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.804159 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9a588-6e43-47c5-97eb-f0f297778790 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.804438 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9a588-6e43-47c5-97eb-f0f297778790 None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.805075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9a588-6e43-47c5-97eb-f0f297778790 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.807111 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9a588-6e43-47c5-97eb-f0f297778790 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.822253 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.828304 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 98/196] 10.222.0.58 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:03 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:03.829116 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9a588-6e43-47c5-97eb-f0f297778790 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.865226 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710dac5a-0e58-40f9-be28-852c8309f3b1 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.890666 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:03.906956 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe19cdc-70ce-47a4-8296-10229ff87e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.907597 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe19cdc-70ce-47a4-8296-10229ff87e5c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.907897 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe19cdc-70ce-47a4-8296-10229ff87e5c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.908171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe19cdc-70ce-47a4-8296-10229ff87e5c None admin] PATH_INFO: `/v3/users/5c8ad19fd0c84f78930e1175d48a7f50` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.909353 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe19cdc-70ce-47a4-8296-10229ff87e5c None admin] RBAC: Authorizing `identity:get_user(user_id=5c8ad19fd0c84f78930e1175d48a7f50)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.910835 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe19cdc-70ce-47a4-8296-10229ff87e5c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:03.912668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 99/197] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/users/5c8ad19fd0c84f78930e1175d48a7f50 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:03.913287 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe19cdc-70ce-47a4-8296-10229ff87e5c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:03.948030 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9a588-6e43-47c5-97eb-f0f297778790 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:03.987992 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0dede-4269-4e8b-a920-491a4dfc5609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:03.988533 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0dede-4269-4e8b-a920-491a4dfc5609 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:03.988810 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0dede-4269-4e8b-a920-491a4dfc5609 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:03.989137 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0dede-4269-4e8b-a920-491a4dfc5609 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:03.989821 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0dede-4269-4e8b-a920-491a4dfc5609 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:03.990123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0dede-4269-4e8b-a920-491a4dfc5609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:03.991543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0dede-4269-4e8b-a920-491a4dfc5609 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:04.002419 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 99/198] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:04.003177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0dede-4269-4e8b-a920-491a4dfc5609 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:04.032449 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe19cdc-70ce-47a4-8296-10229ff87e5c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:04.073843 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807eb0-a3c3-4252-bd8d-94ed56832d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:04.074688 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807eb0-a3c3-4252-bd8d-94ed56832d31 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:04.074972 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807eb0-a3c3-4252-bd8d-94ed56832d31 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:04.075242 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a807eb0-a3c3-4252-bd8d-94ed56832d31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:04.093288 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:04.125657 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0dede-4269-4e8b-a920-491a4dfc5609 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:04.143495 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:04.162298 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a807eb0-a3c3-4252-bd8d-94ed56832d31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:04.163772 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a807eb0-a3c3-4252-bd8d-94ed56832d31 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:04.167135 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab28f5-a382-43b8-82c9-d695a76e640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:04.167749 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab28f5-a382-43b8-82c9-d695a76e640a None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:04.168059 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab28f5-a382-43b8-82c9-d695a76e640a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:04.168333 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab28f5-a382-43b8-82c9-d695a76e640a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:04.259414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab28f5-a382-43b8-82c9-d695a76e640a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:04.261422 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab28f5-a382-43b8-82c9-d695a76e640a None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:04.300711 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 100/199] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:04.301514 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807eb0-a3c3-4252-bd8d-94ed56832d31 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:04.371519 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 100/200] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:04.372455 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:04.373025 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab28f5-a382-43b8-82c9-d695a76e640a None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:04.390479 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:04.445091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a807eb0-a3c3-4252-bd8d-94ed56832d31 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:04.486829 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd0761-6325-4731-9e16-b1e848c425d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:04.487042 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab28f5-a382-43b8-82c9-d695a76e640a None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:04.487690 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd0761-6325-4731-9e16-b1e848c425d0 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:04.488094 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd0761-6325-4731-9e16-b1e848c425d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:04.488587 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd0761-6325-4731-9e16-b1e848c425d0 None admin] PATH_INFO: `/v3/users/4bfc1715f2aa4c458f0171797050897a` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:04.489944 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd0761-6325-4731-9e16-b1e848c425d0 None admin] RBAC: Authorizing `identity:get_user(user_id=4bfc1715f2aa4c458f0171797050897a)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:04.491512 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd0761-6325-4731-9e16-b1e848c425d0 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:04.495929 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 101/201] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:04 2022] GET /identity/v3/users/4bfc1715f2aa4c458f0171797050897a => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:04.498452 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd0761-6325-4731-9e16-b1e848c425d0 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:04.547380 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5318928-667b-4f46-b311-369ffb696bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:04.548206 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5318928-667b-4f46-b311-369ffb696bea None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:04.548585 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5318928-667b-4f46-b311-369ffb696bea None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:04.548954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5318928-667b-4f46-b311-369ffb696bea None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:04.550301 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5318928-667b-4f46-b311-369ffb696bea None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:04.552026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5318928-667b-4f46-b311-369ffb696bea None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:04.554171 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 101/202] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:04 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:04.555946 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5318928-667b-4f46-b311-369ffb696bea None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:04.618752 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd0761-6325-4731-9e16-b1e848c425d0 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:04.632973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:04.650593 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:04.656088 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677934b-fe10-4c06-bba5-17399f21b615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:04.656796 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677934b-fe10-4c06-bba5-17399f21b615 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:04.657149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677934b-fe10-4c06-bba5-17399f21b615 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:04.657513 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677934b-fe10-4c06-bba5-17399f21b615 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:04.658766 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677934b-fe10-4c06-bba5-17399f21b615 None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:04.660395 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677934b-fe10-4c06-bba5-17399f21b615 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:04.662459 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 102/203] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:04 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:04.663429 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677934b-fe10-4c06-bba5-17399f21b615 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:04.673426 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5318928-667b-4f46-b311-369ffb696bea None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:04.713256 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252a225-b48f-435c-9029-b4cb01f0be00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:04.714008 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252a225-b48f-435c-9029-b4cb01f0be00 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:04.714293 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252a225-b48f-435c-9029-b4cb01f0be00 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:04.714567 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252a225-b48f-435c-9029-b4cb01f0be00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:04.772353 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677934b-fe10-4c06-bba5-17399f21b615 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:04.795543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252a225-b48f-435c-9029-b4cb01f0be00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:04.797092 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252a225-b48f-435c-9029-b4cb01f0be00 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:04.809247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e09fd-37ea-406a-970f-ef579b45bebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:04.809907 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e09fd-37ea-406a-970f-ef579b45bebd None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:04.810260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e09fd-37ea-406a-970f-ef579b45bebd None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:04.810597 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e09fd-37ea-406a-970f-ef579b45bebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:04.811401 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e09fd-37ea-406a-970f-ef579b45bebd None admin] RBAC: Adding query filter params (role.id=81a7cb1c95fd45708dbee5e4dc91626b, scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff, user.id=5c8ad19fd0c84f78930e1175d48a7f50) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:04.811776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e09fd-37ea-406a-970f-ef579b45bebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:04.813294 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e09fd-37ea-406a-970f-ef579b45bebd None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:04.818908 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 103/204] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:04 2022] GET /identity/v3/role_assignments?user.id=5c8ad19fd0c84f78930e1175d48a7f50&scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff&role.id=81a7cb1c95fd45708dbee5e4dc91626b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:04.819860 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e09fd-37ea-406a-970f-ef579b45bebd None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:04.873993 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:04.893700 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:04.917368 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 102/205] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:04.923249 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252a225-b48f-435c-9029-b4cb01f0be00 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:04.935107 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e09fd-37ea-406a-970f-ef579b45bebd None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:04.972977 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad327032-3950-42cd-9a19-8fcbc703e52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:04.973708 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad327032-3950-42cd-9a19-8fcbc703e52c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:04.974050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad327032-3950-42cd-9a19-8fcbc703e52c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:04.974607 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad327032-3950-42cd-9a19-8fcbc703e52c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:04.975172 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad327032-3950-42cd-9a19-8fcbc703e52c None admin] RBAC: Adding query filter params (role.id=035d7eb5fa4e47919e159810a449df68, scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff, user.id=5c8ad19fd0c84f78930e1175d48a7f50) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:04.975544 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad327032-3950-42cd-9a19-8fcbc703e52c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:04.977673 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad327032-3950-42cd-9a19-8fcbc703e52c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:04.984673 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 104/206] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:04 2022] GET /identity/v3/role_assignments?user.id=5c8ad19fd0c84f78930e1175d48a7f50&scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff&role.id=035d7eb5fa4e47919e159810a449df68 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:05.045465 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252a225-b48f-435c-9029-b4cb01f0be00 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:05.087504 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e411c-c54a-412b-a68b-b6eb4499e90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:05.088418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e411c-c54a-412b-a68b-b6eb4499e90b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:05.088830 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e411c-c54a-412b-a68b-b6eb4499e90b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:05.089244 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e411c-c54a-412b-a68b-b6eb4499e90b None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:05.090677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e411c-c54a-412b-a68b-b6eb4499e90b None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:05.092400 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e411c-c54a-412b-a68b-b6eb4499e90b None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:05.094635 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 103/207] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:04 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:05.101192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad327032-3950-42cd-9a19-8fcbc703e52c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:05.222161 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad327032-3950-42cd-9a19-8fcbc703e52c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:05.252224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:05.262697 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fd780-b0c2-4f29-b058-ba7d7bd3792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:05.263318 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fd780-b0c2-4f29-b058-ba7d7bd3792f None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:05.263597 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fd780-b0c2-4f29-b058-ba7d7bd3792f None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:05.263888 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fd780-b0c2-4f29-b058-ba7d7bd3792f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:05.264678 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fd780-b0c2-4f29-b058-ba7d7bd3792f None admin] RBAC: Adding query filter params (role.id=eefe4f9f49e4401a929ce82b866421d7, scope.project.id=f40ec939fdcc422995f7ce0c3973152d, user.id=4bfc1715f2aa4c458f0171797050897a) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:05.264986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fd780-b0c2-4f29-b058-ba7d7bd3792f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:05.266494 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fd780-b0c2-4f29-b058-ba7d7bd3792f None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:05.273695 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 105/208] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:05 2022] GET /identity/v3/role_assignments?user.id=4bfc1715f2aa4c458f0171797050897a&scope.project.id=f40ec939fdcc422995f7ce0c3973152d&role.id=eefe4f9f49e4401a929ce82b866421d7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:06.335843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6c87b-b77a-48a7-ad0b-da4641ae91da None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:06.336872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6c87b-b77a-48a7-ad0b-da4641ae91da None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:06.337108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6c87b-b77a-48a7-ad0b-da4641ae91da None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:06.338750 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 104/209] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:06.344015 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a3dd0-46f8-420e-ab85-a3492b4cb717 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:06.344453 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a3dd0-46f8-420e-ab85-a3492b4cb717 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:06.344624 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a3dd0-46f8-420e-ab85-a3492b4cb717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:06.364792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-378a3dd0-46f8-420e-ab85-a3492b4cb717 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:06.365994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-378a3dd0-46f8-420e-ab85-a3492b4cb717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:06.442782 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 106/210] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:06.475434 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cfe16-4eb5-4e6b-9929-1923a5071289 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:06.475725 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cfe16-4eb5-4e6b-9929-1923a5071289 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:06.476100 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cfe16-4eb5-4e6b-9929-1923a5071289 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:06.478223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 105/211] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:06.483669 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a4f9-a1c3-48f2-988c-65ba7c1f085f None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:06.484006 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a4f9-a1c3-48f2-988c-65ba7c1f085f None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:06.484289 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a4f9-a1c3-48f2-988c-65ba7c1f085f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:06.503707 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-d3e1a4f9-a1c3-48f2-988c-65ba7c1f085f None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:06.504831 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-d3e1a4f9-a1c3-48f2-988c-65ba7c1f085f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:06.575700 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 107/212] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:06.776859 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cfe16-4eb5-4e6b-9929-1923a5071289 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:06.834818 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:06.894318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cfe16-4eb5-4e6b-9929-1923a5071289 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:06.917050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1a4f9-a1c3-48f2-988c-65ba7c1f085f None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:06.931942 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cd57f-bf86-4716-8ae2-06a5cc67d95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:06.932708 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd57f-bf86-4716-8ae2-06a5cc67d95a None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:06.933003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd57f-bf86-4716-8ae2-06a5cc67d95a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:06.933271 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd57f-bf86-4716-8ae2-06a5cc67d95a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:06.944804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cd57f-bf86-4716-8ae2-06a5cc67d95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-7d6cd57f-bf86-4716-8ae2-06a5cc67d95a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:06.950843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:06.951774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:06.952637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 106/213] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:06.958827 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cd57f-bf86-4716-8ae2-06a5cc67d95a None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:06.961189 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:07.057345 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1a4f9-a1c3-48f2-988c-65ba7c1f085f None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:07.069462 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cd57f-bf86-4716-8ae2-06a5cc67d95a None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:07.081694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:07.113893 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e7799-91ff-4b23-ba6f-0eafa7d6d87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:07.114444 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb631f63-82fe-430d-ab5b-1b8c30138a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:07.115144 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e7799-91ff-4b23-ba6f-0eafa7d6d87c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.115273 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb631f63-82fe-430d-ab5b-1b8c30138a58 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.115488 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb631f63-82fe-430d-ab5b-1b8c30138a58 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.115770 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb631f63-82fe-430d-ab5b-1b8c30138a58 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.116163 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e7799-91ff-4b23-ba6f-0eafa7d6d87c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.116471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb631f63-82fe-430d-ab5b-1b8c30138a58 None admin] RBAC: Adding query filter params (name=member) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:07.116772 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb631f63-82fe-430d-ab5b-1b8c30138a58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:07.117046 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e7799-91ff-4b23-ba6f-0eafa7d6d87c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.118396 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb631f63-82fe-430d-ab5b-1b8c30138a58 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:07.118725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e7799-91ff-4b23-ba6f-0eafa7d6d87c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:07.120443 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e7799-91ff-4b23-ba6f-0eafa7d6d87c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:07.126924 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 108/214] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:07.128009 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e7799-91ff-4b23-ba6f-0eafa7d6d87c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:07.128216 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 107/215] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:07.135122 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb631f63-82fe-430d-ab5b-1b8c30138a58 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:07.271182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e7799-91ff-4b23-ba6f-0eafa7d6d87c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:07.271766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb631f63-82fe-430d-ab5b-1b8c30138a58 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:07.273208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:07.314265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e116b-9be9-4a4b-b969-5dd6965e5d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:07.315258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e116b-9be9-4a4b-b969-5dd6965e5d90 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.315743 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e116b-9be9-4a4b-b969-5dd6965e5d90 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.316283 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e116b-9be9-4a4b-b969-5dd6965e5d90 None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.317175 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e116b-9be9-4a4b-b969-5dd6965e5d90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:07.319087 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e116b-9be9-4a4b-b969-5dd6965e5d90 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:07.321772 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae2b54-aad9-42d6-be18-7402f26858ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:07.322421 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae2b54-aad9-42d6-be18-7402f26858ee None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.322699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae2b54-aad9-42d6-be18-7402f26858ee None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.322972 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae2b54-aad9-42d6-be18-7402f26858ee None admin] PATH_INFO: `/v3/users/fe495c7c821543a59dac21f73588c264` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.342320 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae2b54-aad9-42d6-be18-7402f26858ee None admin] RBAC: Authorizing `identity:get_user(user_id=fe495c7c821543a59dac21f73588c264)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:07.344313 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae2b54-aad9-42d6-be18-7402f26858ee None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:07.347594 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 108/216] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:07 2022] GET /identity/v3/users/fe495c7c821543a59dac21f73588c264 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:07.354210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae2b54-aad9-42d6-be18-7402f26858ee None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:07.357595 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 109/217] 10.222.0.58 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:07 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:07.397580 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:07.476029 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95213c0a-16a3-4a79-ac09-8e51bb912ffc None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.476341 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95213c0a-16a3-4a79-ac09-8e51bb912ffc None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.476592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95213c0a-16a3-4a79-ac09-8e51bb912ffc None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.480256 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 110/218] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:07.484013 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae2b54-aad9-42d6-be18-7402f26858ee None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:07.488579 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7379e4-0eaf-4074-b4fb-fc75f5f94eb8 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.488868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7379e4-0eaf-4074-b4fb-fc75f5f94eb8 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.489156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7379e4-0eaf-4074-b4fb-fc75f5f94eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.514835 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-8b7379e4-0eaf-4074-b4fb-fc75f5f94eb8 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:07.516116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-8b7379e4-0eaf-4074-b4fb-fc75f5f94eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:07.529721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e166b5-2c2a-42dc-8b21-289fcd3a4065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:07.530649 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e166b5-2c2a-42dc-8b21-289fcd3a4065 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.530928 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e166b5-2c2a-42dc-8b21-289fcd3a4065 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.531198 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e166b5-2c2a-42dc-8b21-289fcd3a4065 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.598075 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 111/219] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:07.599103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4a20-0fa1-4602-b0f9-ee805ebdd2a4 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.599372 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4a20-0fa1-4602-b0f9-ee805ebdd2a4 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.599643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4a20-0fa1-4602-b0f9-ee805ebdd2a4 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.600934 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 112/220] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:07.606321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942b6b-4fe0-4625-b1fd-82fb93eae844 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.606605 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942b6b-4fe0-4625-b1fd-82fb93eae844 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.606880 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942b6b-4fe0-4625-b1fd-82fb93eae844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.611415 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e166b5-2c2a-42dc-8b21-289fcd3a4065 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:07.613827 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e166b5-2c2a-42dc-8b21-289fcd3a4065 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:07.631358 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-a5942b6b-4fe0-4625-b1fd-82fb93eae844 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:07.634247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-a5942b6b-4fe0-4625-b1fd-82fb93eae844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:07.657189 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:07.726870 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 113/221] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:07.749438 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 109/222] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:07:07.755251 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5942b6b-4fe0-4625-b1fd-82fb93eae844 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:07.775307 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:07.866341 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5942b6b-4fe0-4625-b1fd-82fb93eae844 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:07.904225 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb4672-95bd-425f-a9eb-34f6c66c3697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:07.904862 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb4672-95bd-425f-a9eb-34f6c66c3697 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:07.905148 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb4672-95bd-425f-a9eb-34f6c66c3697 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:07.905422 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb4672-95bd-425f-a9eb-34f6c66c3697 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:07.906561 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb4672-95bd-425f-a9eb-34f6c66c3697 None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:07.908047 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb4672-95bd-425f-a9eb-34f6c66c3697 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:07.909685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 114/223] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:07 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:07.915872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e166b5-2c2a-42dc-8b21-289fcd3a4065 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:07.980493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb4672-95bd-425f-a9eb-34f6c66c3697 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.100975 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:08.104124 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e166b5-2c2a-42dc-8b21-289fcd3a4065 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:08.120776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb4672-95bd-425f-a9eb-34f6c66c3697 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:08.143520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:08.153787 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cf4c1-620c-40c0-9730-209f916cc5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:08.154551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cf4c1-620c-40c0-9730-209f916cc5e2 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.154965 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cf4c1-620c-40c0-9730-209f916cc5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.155249 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cf4c1-620c-40c0-9730-209f916cc5e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.156300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cf4c1-620c-40c0-9730-209f916cc5e2 None admin] RBAC: Adding query filter params (role.id=57d5f513f8fd4d7dbd1ef0ecc319892e, scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff, user.id=fe495c7c821543a59dac21f73588c264) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:08.156617 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cf4c1-620c-40c0-9730-209f916cc5e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:08.158773 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cf4c1-620c-40c0-9730-209f916cc5e2 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:08.166632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77db26-4b41-47cd-9596-a52a0d9d3cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:08.168036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77db26-4b41-47cd-9596-a52a0d9d3cf2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.168252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77db26-4b41-47cd-9596-a52a0d9d3cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.168678 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77db26-4b41-47cd-9596-a52a0d9d3cf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.168807 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 110/224] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:07 2022] GET /identity/v3/role_assignments?user.id=fe495c7c821543a59dac21f73588c264&scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff&role.id=57d5f513f8fd4d7dbd1ef0ecc319892e => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:08.169749 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cf4c1-620c-40c0-9730-209f916cc5e2 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.182107 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77db26-4b41-47cd-9596-a52a0d9d3cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-9a77db26-4b41-47cd-9596-a52a0d9d3cf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:08.187905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:08.188868 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:08.189632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 115/225] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:08.197036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77db26-4b41-47cd-9596-a52a0d9d3cf2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.386475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cf4c1-620c-40c0-9730-209f916cc5e2 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:08.423713 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6a967-59d6-438b-9bd7-f515ffb85661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:08.424428 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6a967-59d6-438b-9bd7-f515ffb85661 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.425051 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6a967-59d6-438b-9bd7-f515ffb85661 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.425343 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6a967-59d6-438b-9bd7-f515ffb85661 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.436765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6a967-59d6-438b-9bd7-f515ffb85661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-f3d6a967-59d6-438b-9bd7-f515ffb85661 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:08.442120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:08.443006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:08.443792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 111/226] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:08.450418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6a967-59d6-438b-9bd7-f515ffb85661 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.454810 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77db26-4b41-47cd-9596-a52a0d9d3cf2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:08.520190 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:08.564439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6a967-59d6-438b-9bd7-f515ffb85661 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:08.603595 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533dbc0-0819-4eaa-b347-69e1ea300bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:08.603854 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ff576-3815-4fec-9cc8-ea3c6718d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:08.604246 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533dbc0-0819-4eaa-b347-69e1ea300bc7 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.604352 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ff576-3815-4fec-9cc8-ea3c6718d97b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.604519 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533dbc0-0819-4eaa-b347-69e1ea300bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.604618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ff576-3815-4fec-9cc8-ea3c6718d97b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.604789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533dbc0-0819-4eaa-b347-69e1ea300bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.604883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ff576-3815-4fec-9cc8-ea3c6718d97b None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.605463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533dbc0-0819-4eaa-b347-69e1ea300bc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:08.605578 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ff576-3815-4fec-9cc8-ea3c6718d97b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:08.605761 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533dbc0-0819-4eaa-b347-69e1ea300bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:08.605855 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ff576-3815-4fec-9cc8-ea3c6718d97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:08.607145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533dbc0-0819-4eaa-b347-69e1ea300bc7 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:08.607266 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ff576-3815-4fec-9cc8-ea3c6718d97b None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:08.615537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 112/227] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:08.622144 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ff576-3815-4fec-9cc8-ea3c6718d97b None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.641793 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 116/228] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:08.649766 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533dbc0-0819-4eaa-b347-69e1ea300bc7 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.683572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:08.767918 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ff576-3815-4fec-9cc8-ea3c6718d97b None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:08.794570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:08.812259 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533dbc0-0819-4eaa-b347-69e1ea300bc7 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:08.824423 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a39f6-f534-457e-9f0a-bf3f2acd8f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:08.825069 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a39f6-f534-457e-9f0a-bf3f2acd8f37 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.825350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a39f6-f534-457e-9f0a-bf3f2acd8f37 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.825623 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a39f6-f534-457e-9f0a-bf3f2acd8f37 None admin] PATH_INFO: `/v3/users/5c8ad19fd0c84f78930e1175d48a7f50` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.826780 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a39f6-f534-457e-9f0a-bf3f2acd8f37 None admin] RBAC: Authorizing `identity:get_user(user_id=5c8ad19fd0c84f78930e1175d48a7f50)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:08.828280 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a39f6-f534-457e-9f0a-bf3f2acd8f37 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:08.830176 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 113/229] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:08 2022] GET /identity/v3/users/5c8ad19fd0c84f78930e1175d48a7f50 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:08.835950 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a39f6-f534-457e-9f0a-bf3f2acd8f37 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.885416 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26522ccc-8a05-4296-98db-d72ef04a76f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:08.886066 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26522ccc-8a05-4296-98db-d72ef04a76f8 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:08.886347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26522ccc-8a05-4296-98db-d72ef04a76f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:08.886621 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26522ccc-8a05-4296-98db-d72ef04a76f8 None admin] PATH_INFO: `/v3/users/5c8ad19fd0c84f78930e1175d48a7f50` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:08.892606 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26522ccc-8a05-4296-98db-d72ef04a76f8 None admin] RBAC: Authorizing `identity:get_user(user_id=5c8ad19fd0c84f78930e1175d48a7f50)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:08.894020 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26522ccc-8a05-4296-98db-d72ef04a76f8 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:08.895976 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 117/230] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:08 2022] GET /identity/v3/users/5c8ad19fd0c84f78930e1175d48a7f50 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:08.901758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26522ccc-8a05-4296-98db-d72ef04a76f8 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:08.978112 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a39f6-f534-457e-9f0a-bf3f2acd8f37 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:09.016658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e669a-723b-4eb2-b46d-08b882098a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:09.017355 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e669a-723b-4eb2-b46d-08b882098a06 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.017639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e669a-723b-4eb2-b46d-08b882098a06 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.017912 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e669a-723b-4eb2-b46d-08b882098a06 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.019098 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e669a-723b-4eb2-b46d-08b882098a06 None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:09.020743 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e669a-723b-4eb2-b46d-08b882098a06 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:09.022549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 114/231] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:08 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:09.029302 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e669a-723b-4eb2-b46d-08b882098a06 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:09.087747 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:09.090882 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:09.140999 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26522ccc-8a05-4296-98db-d72ef04a76f8 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:09.175736 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e669a-723b-4eb2-b46d-08b882098a06 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:09.205409 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f68be0-b350-43a5-8be7-e8c7d7d1111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:09.206043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68be0-b350-43a5-8be7-e8c7d7d1111d None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.206326 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68be0-b350-43a5-8be7-e8c7d7d1111d None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.206599 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f68be0-b350-43a5-8be7-e8c7d7d1111d None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.212556 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f68be0-b350-43a5-8be7-e8c7d7d1111d None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:09.214023 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f68be0-b350-43a5-8be7-e8c7d7d1111d None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:09.216028 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 118/232] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:08 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:09.224701 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f68be0-b350-43a5-8be7-e8c7d7d1111d None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:09.229561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b05b1-2df2-4cd6-967b-57a7c5a8b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:09.230233 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b05b1-2df2-4cd6-967b-57a7c5a8b3f2 None admin] REQUEST_METHOD: `PUT` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.230523 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b05b1-2df2-4cd6-967b-57a7c5a8b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.230793 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b05b1-2df2-4cd6-967b-57a7c5a8b3f2 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff/users/5c8ad19fd0c84f78930e1175d48a7f50/roles/035d7eb5fa4e47919e159810a449df68` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.233102 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b05b1-2df2-4cd6-967b-57a7c5a8b3f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b0cf9bc7ac44fb9653e814ea675fff, user_id=5c8ad19fd0c84f78930e1175d48a7f50, role_id=035d7eb5fa4e47919e159810a449df68)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:09.234664 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b05b1-2df2-4cd6-967b-57a7c5a8b3f2 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:09.266823 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 115/233] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:09 2022] PUT /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff/users/5c8ad19fd0c84f78930e1175d48a7f50/roles/035d7eb5fa4e47919e159810a449df68 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:09.369451 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f68be0-b350-43a5-8be7-e8c7d7d1111d None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:09.407723 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1987420-f3a7-4675-b617-2719b5fe819a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:09.408447 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1987420-f3a7-4675-b617-2719b5fe819a None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:09.408740 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1987420-f3a7-4675-b617-2719b5fe819a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:09.409006 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1987420-f3a7-4675-b617-2719b5fe819a None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff/users/5c8ad19fd0c84f78930e1175d48a7f50/roles/81a7cb1c95fd45708dbee5e4dc91626b` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:09.411088 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1987420-f3a7-4675-b617-2719b5fe819a None admin] RBAC: Authorizing `identity:create_grant(project_id=55b0cf9bc7ac44fb9653e814ea675fff, user_id=5c8ad19fd0c84f78930e1175d48a7f50, role_id=81a7cb1c95fd45708dbee5e4dc91626b)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:09.412621 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1987420-f3a7-4675-b617-2719b5fe819a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:09.433194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 119/234] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:09 2022] PUT /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff/users/5c8ad19fd0c84f78930e1175d48a7f50/roles/81a7cb1c95fd45708dbee5e4dc91626b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:10.295951 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6ca36-5695-4341-aae3-5cf306509ade None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:10.296461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6ca36-5695-4341-aae3-5cf306509ade None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:10.296535 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6ca36-5695-4341-aae3-5cf306509ade None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:10.297979 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 116/235] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:10.305857 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb5c0-414b-45c8-911d-e01583d15457 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:10.306342 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb5c0-414b-45c8-911d-e01583d15457 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:10.306469 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb5c0-414b-45c8-911d-e01583d15457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:10.316619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439a7df-dda3-4bf3-9dad-83e68ba985c9 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:10.316908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439a7df-dda3-4bf3-9dad-83e68ba985c9 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:10.317189 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439a7df-dda3-4bf3-9dad-83e68ba985c9 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:10.318510 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 117/236] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:10.319609 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:10.333351 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d020e-3417-4068-8f85-714a0ca98e16 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:10.333640 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d020e-3417-4068-8f85-714a0ca98e16 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:10.333899 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d020e-3417-4068-8f85-714a0ca98e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:10.335748 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-464bb5c0-414b-45c8-911d-e01583d15457 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:10.337646 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-464bb5c0-414b-45c8-911d-e01583d15457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:10.361102 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-b21d020e-3417-4068-8f85-714a0ca98e16 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:10.362295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-b21d020e-3417-4068-8f85-714a0ca98e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:10.435063 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 120/237] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:10.484813 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 118/238] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:10.768262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bb5c0-414b-45c8-911d-e01583d15457 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:10.893863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bb5c0-414b-45c8-911d-e01583d15457 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:10.935328 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a738169-5339-41fd-b391-a43b9387a9db None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:10.935660 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a738169-5339-41fd-b391-a43b9387a9db None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:10.935924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a738169-5339-41fd-b391-a43b9387a9db None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:10.937820 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 119/239] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:10.944836 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84119b-9a07-4d08-8253-69ca3f314a80 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:10.945409 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84119b-9a07-4d08-8253-69ca3f314a80 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:10.946581 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84119b-9a07-4d08-8253-69ca3f314a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:10.959642 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8d1ef-21f2-47ec-a359-5b01c6a8bb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:10.960482 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8d1ef-21f2-47ec-a359-5b01c6a8bb97 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:10.962666 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8d1ef-21f2-47ec-a359-5b01c6a8bb97 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:10.963094 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8d1ef-21f2-47ec-a359-5b01c6a8bb97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:10.969518 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8d1ef-21f2-47ec-a359-5b01c6a8bb97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:10.971409 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8d1ef-21f2-47ec-a359-5b01c6a8bb97 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:10.973232 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 121/240] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:10.979036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8d1ef-21f2-47ec-a359-5b01c6a8bb97 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:10.980868 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-0f84119b-9a07-4d08-8253-69ca3f314a80 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:10.982078 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-0f84119b-9a07-4d08-8253-69ca3f314a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:10.982203 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:11.033801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:11.079089 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 120/241] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:11.080461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84119b-9a07-4d08-8253-69ca3f314a80 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:11.119944 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8d1ef-21f2-47ec-a359-5b01c6a8bb97 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:11.188886 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d45441-e348-422f-9099-13e48ab1e9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:11.189749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d45441-e348-422f-9099-13e48ab1e9cb None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:11.190034 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d45441-e348-422f-9099-13e48ab1e9cb None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:11.190305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d45441-e348-422f-9099-13e48ab1e9cb None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:11.190944 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d45441-e348-422f-9099-13e48ab1e9cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:11.192463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d45441-e348-422f-9099-13e48ab1e9cb None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:11.230852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 122/242] 10.222.0.58 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:10 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:11.275094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84119b-9a07-4d08-8253-69ca3f314a80 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:11.325263 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4a7b8-8d31-492d-8266-605b0dad7574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:11.325877 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4a7b8-8d31-492d-8266-605b0dad7574 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:11.326119 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4a7b8-8d31-492d-8266-605b0dad7574 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:11.326366 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4a7b8-8d31-492d-8266-605b0dad7574 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:11.338757 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4a7b8-8d31-492d-8266-605b0dad7574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-dbd4a7b8-8d31-492d-8266-605b0dad7574 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:11.343812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:11.344987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:11.345775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 121/243] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:11.353150 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d45441-e348-422f-9099-13e48ab1e9cb None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:11.422430 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:11.424938 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4a7b8-8d31-492d-8266-605b0dad7574 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:11.486968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:11.502823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d45441-e348-422f-9099-13e48ab1e9cb None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:11.547317 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c993b6-5dc5-4de2-9118-20d0b100cecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:11.548225 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c993b6-5dc5-4de2-9118-20d0b100cecd None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:11.548651 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c993b6-5dc5-4de2-9118-20d0b100cecd None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:11.549066 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c993b6-5dc5-4de2-9118-20d0b100cecd None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:11.550437 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c993b6-5dc5-4de2-9118-20d0b100cecd None admin] RBAC: Adding query filter params (name=reader) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:11.550902 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c993b6-5dc5-4de2-9118-20d0b100cecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:11.552920 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c993b6-5dc5-4de2-9118-20d0b100cecd None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:11.565811 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 123/244] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:11.573052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c993b6-5dc5-4de2-9118-20d0b100cecd None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:11.590006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4a7b8-8d31-492d-8266-605b0dad7574 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:11.642292 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbfd9b-b27c-4668-b781-e73d0ed1dfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:11.643273 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbfd9b-b27c-4668-b781-e73d0ed1dfce None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:11.643700 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbfd9b-b27c-4668-b781-e73d0ed1dfce None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:11.644195 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbfd9b-b27c-4668-b781-e73d0ed1dfce None admin] PATH_INFO: `/v3/roles/member` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:11.659889 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbfd9b-b27c-4668-b781-e73d0ed1dfce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-45dbfd9b-b27c-4668-b781-e73d0ed1dfce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:11.669604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:11.670926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:11.672655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:11.672655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:11.672655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:11.672655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:11.672655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:11.672655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:11.672655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:11.672655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:11.672655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:11.672655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:11.672655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:11.672655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:11.675251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 122/245] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:11.681334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbfd9b-b27c-4668-b781-e73d0ed1dfce None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:11.702070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c993b6-5dc5-4de2-9118-20d0b100cecd None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:11.732238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:11.757106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a190b74-c77e-4fde-970b-68ec11963a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:11.758021 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a190b74-c77e-4fde-970b-68ec11963a33 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:11.759024 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a190b74-c77e-4fde-970b-68ec11963a33 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:11.759683 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a190b74-c77e-4fde-970b-68ec11963a33 None admin] PATH_INFO: `/v3/users/f2a31e6bfdb240e98c5c617b60a6c100` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:11.779292 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a190b74-c77e-4fde-970b-68ec11963a33 None admin] RBAC: Authorizing `identity:get_user(user_id=f2a31e6bfdb240e98c5c617b60a6c100)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:11.781312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a190b74-c77e-4fde-970b-68ec11963a33 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:11.784151 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 124/246] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:11 2022] GET /identity/v3/users/f2a31e6bfdb240e98c5c617b60a6c100 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:11.791171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a190b74-c77e-4fde-970b-68ec11963a33 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:11.818513 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:11.831177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbfd9b-b27c-4668-b781-e73d0ed1dfce None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:11.874585 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3accde1-ce52-44d1-af72-76ef2dc4e49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:11.875513 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3accde1-ce52-44d1-af72-76ef2dc4e49f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:11.875962 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3accde1-ce52-44d1-af72-76ef2dc4e49f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:11.876498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3accde1-ce52-44d1-af72-76ef2dc4e49f None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:11.877607 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3accde1-ce52-44d1-af72-76ef2dc4e49f None admin] RBAC: Adding query filter params (name=member) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:11.878196 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3accde1-ce52-44d1-af72-76ef2dc4e49f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:11.879713 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3accde1-ce52-44d1-af72-76ef2dc4e49f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:11.891283 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 123/247] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:11.896427 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3accde1-ce52-44d1-af72-76ef2dc4e49f None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:11.944993 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a190b74-c77e-4fde-970b-68ec11963a33 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:11.993662 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0fe7da-2cd0-41b8-b121-f92a387d1ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:11.994678 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fe7da-2cd0-41b8-b121-f92a387d1ab8 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:11.996549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fe7da-2cd0-41b8-b121-f92a387d1ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:11.997760 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0fe7da-2cd0-41b8-b121-f92a387d1ab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.030888 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3accde1-ce52-44d1-af72-76ef2dc4e49f None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:12.054193 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:12.069758 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e643d6-6f2b-4ee1-b0f3-d932df4192b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:12.070390 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e643d6-6f2b-4ee1-b0f3-d932df4192b1 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.071008 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e643d6-6f2b-4ee1-b0f3-d932df4192b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.071008 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e643d6-6f2b-4ee1-b0f3-d932df4192b1 None admin] PATH_INFO: `/v3/users/fe495c7c821543a59dac21f73588c264` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.072250 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e643d6-6f2b-4ee1-b0f3-d932df4192b1 None admin] RBAC: Authorizing `identity:get_user(user_id=fe495c7c821543a59dac21f73588c264)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:12.073831 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e643d6-6f2b-4ee1-b0f3-d932df4192b1 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:12.075592 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 124/248] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:11 2022] GET /identity/v3/users/fe495c7c821543a59dac21f73588c264 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:12.081513 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e643d6-6f2b-4ee1-b0f3-d932df4192b1 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:12.109024 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fe7da-2cd0-41b8-b121-f92a387d1ab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:12.110532 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0fe7da-2cd0-41b8-b121-f92a387d1ab8 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:12.112680 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:12.198085 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e643d6-6f2b-4ee1-b0f3-d932df4192b1 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:12.243545 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883586b2-d1a2-45bf-a841-3e382b4717cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:12.244300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883586b2-d1a2-45bf-a841-3e382b4717cc None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.244583 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883586b2-d1a2-45bf-a841-3e382b4717cc None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.244860 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883586b2-d1a2-45bf-a841-3e382b4717cc None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.246015 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883586b2-d1a2-45bf-a841-3e382b4717cc None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:12.247481 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883586b2-d1a2-45bf-a841-3e382b4717cc None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:12.249430 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 125/249] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:12 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:12.250563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb008670-e8c9-4448-9549-2f38cd971248 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.250850 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb008670-e8c9-4448-9549-2f38cd971248 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.251124 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb008670-e8c9-4448-9549-2f38cd971248 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.257168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 126/250] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:12.258927 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb008670-e8c9-4448-9549-2f38cd971248 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:12.329947 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 125/251] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:07:12.331236 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d28ebb-cff0-4488-af4d-c887ad69ff27 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.331817 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d28ebb-cff0-4488-af4d-c887ad69ff27 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.332117 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d28ebb-cff0-4488-af4d-c887ad69ff27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.354767 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-b5d28ebb-cff0-4488-af4d-c887ad69ff27 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:12.356137 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-b5d28ebb-cff0-4488-af4d-c887ad69ff27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:12.404549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:12.418518 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb008670-e8c9-4448-9549-2f38cd971248 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:12.453939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 126/252] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:12.454713 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d28ebb-cff0-4488-af4d-c887ad69ff27 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:12.456379 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c752b-c033-41a0-9179-d7352ff4ed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:12.457143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c752b-c033-41a0-9179-d7352ff4ed77 None admin] REQUEST_METHOD: `PUT` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.457524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c752b-c033-41a0-9179-d7352ff4ed77 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.457956 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c752b-c033-41a0-9179-d7352ff4ed77 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff/users/fe495c7c821543a59dac21f73588c264/roles/57d5f513f8fd4d7dbd1ef0ecc319892e` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.460472 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c752b-c033-41a0-9179-d7352ff4ed77 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b0cf9bc7ac44fb9653e814ea675fff, user_id=fe495c7c821543a59dac21f73588c264, role_id=57d5f513f8fd4d7dbd1ef0ecc319892e)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:12.462683 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c752b-c033-41a0-9179-d7352ff4ed77 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:12.466731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:12.478278 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 127/253] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:12 2022] PUT /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff/users/fe495c7c821543a59dac21f73588c264/roles/57d5f513f8fd4d7dbd1ef0ecc319892e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:07:12.484981 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a920ea-737a-4b12-a279-33d4b89e3d7f None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.484981 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a920ea-737a-4b12-a279-33d4b89e3d7f None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.484981 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a920ea-737a-4b12-a279-33d4b89e3d7f None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.484981 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 128/254] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:12.488081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fa1d5-b3db-4534-84ce-49a2e44683d1 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.488485 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fa1d5-b3db-4534-84ce-49a2e44683d1 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.488918 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fa1d5-b3db-4534-84ce-49a2e44683d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.510521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-2e3fa1d5-b3db-4534-84ce-49a2e44683d1 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:12.512104 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-2e3fa1d5-b3db-4534-84ce-49a2e44683d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:12.596949 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 129/255] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:12.617057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d28ebb-cff0-4488-af4d-c887ad69ff27 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:12.678622 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7ce91-9837-4a1a-b300-32bf741ac89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:12.679275 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7ce91-9837-4a1a-b300-32bf741ac89c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.679555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7ce91-9837-4a1a-b300-32bf741ac89c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.679880 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7ce91-9837-4a1a-b300-32bf741ac89c None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.684683 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7ce91-9837-4a1a-b300-32bf741ac89c None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:12.686181 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7ce91-9837-4a1a-b300-32bf741ac89c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:12.688130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 127/256] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:12 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:12.694497 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fa1d5-b3db-4534-84ce-49a2e44683d1 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:12.798664 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:12.821099 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fa1d5-b3db-4534-84ce-49a2e44683d1 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:12.860188 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a1b17-8a2b-42c4-a4d2-52538588758f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:12.861141 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a1b17-8a2b-42c4-a4d2-52538588758f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:12.861646 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a1b17-8a2b-42c4-a4d2-52538588758f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:12.862119 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a1b17-8a2b-42c4-a4d2-52538588758f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:12.863035 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a1b17-8a2b-42c4-a4d2-52538588758f None admin] RBAC: Adding query filter params (role.id=eefe4f9f49e4401a929ce82b866421d7, scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff, user.id=f2a31e6bfdb240e98c5c617b60a6c100) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:12.863560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a1b17-8a2b-42c4-a4d2-52538588758f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:12.865305 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a1b17-8a2b-42c4-a4d2-52538588758f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:12.872497 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 130/257] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:12 2022] GET /identity/v3/role_assignments?user.id=f2a31e6bfdb240e98c5c617b60a6c100&scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff&role.id=eefe4f9f49e4401a929ce82b866421d7 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:13.046332 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7ce91-9837-4a1a-b300-32bf741ac89c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:13.128929 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:13.148516 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a1b17-8a2b-42c4-a4d2-52538588758f None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:13.154175 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7ce91-9837-4a1a-b300-32bf741ac89c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:13.198687 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1ed82-0177-4c2f-86d9-5713f34a5d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:13.199789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1ed82-0177-4c2f-86d9-5713f34a5d53 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:13.200300 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1ed82-0177-4c2f-86d9-5713f34a5d53 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:13.200787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1ed82-0177-4c2f-86d9-5713f34a5d53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:13.225106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1ed82-0177-4c2f-86d9-5713f34a5d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-42d1ed82-0177-4c2f-86d9-5713f34a5d53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:13.239638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:13.240598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:13.241387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 128/258] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:13.247781 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1ed82-0177-4c2f-86d9-5713f34a5d53 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:13.294832 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a1b17-8a2b-42c4-a4d2-52538588758f None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:13.333784 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a45403-9313-4e9b-8082-50157f673855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:13.334803 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a45403-9313-4e9b-8082-50157f673855 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:13.335290 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a45403-9313-4e9b-8082-50157f673855 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:13.335763 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a45403-9313-4e9b-8082-50157f673855 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:13.348142 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a45403-9313-4e9b-8082-50157f673855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-54a45403-9313-4e9b-8082-50157f673855 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:13.354738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:13.355619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:13.356451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:13.356451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:13.356451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:13.356451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:13.356451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:13.356451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:13.356451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:13.356451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:13.356451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:13.356451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:13.356451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:13.356451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:13.358930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 131/259] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:13.370533 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a45403-9313-4e9b-8082-50157f673855 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:13.392293 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:13.410799 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1ed82-0177-4c2f-86d9-5713f34a5d53 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:13.446206 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf775a-d6f7-477d-a5cc-5aaac55086bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:13.446814 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf775a-d6f7-477d-a5cc-5aaac55086bc None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:13.447090 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf775a-d6f7-477d-a5cc-5aaac55086bc None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:13.447367 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf775a-d6f7-477d-a5cc-5aaac55086bc None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:13.448058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf775a-d6f7-477d-a5cc-5aaac55086bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:13.448362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf775a-d6f7-477d-a5cc-5aaac55086bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:13.449772 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf775a-d6f7-477d-a5cc-5aaac55086bc None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:13.452087 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:13.459531 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 129/260] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:13.465679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf775a-d6f7-477d-a5cc-5aaac55086bc None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:13.561106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a45403-9313-4e9b-8082-50157f673855 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:13.634341 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf775a-d6f7-477d-a5cc-5aaac55086bc None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:13.635150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441205a-430e-41c0-904e-20058508ad07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:13.636034 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441205a-430e-41c0-904e-20058508ad07 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:13.636598 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441205a-430e-41c0-904e-20058508ad07 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:13.637165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441205a-430e-41c0-904e-20058508ad07 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:13.638043 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441205a-430e-41c0-904e-20058508ad07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:13.638548 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441205a-430e-41c0-904e-20058508ad07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:13.640172 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441205a-430e-41c0-904e-20058508ad07 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:13.656689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 132/261] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:13.673389 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441205a-430e-41c0-904e-20058508ad07 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:13.712853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ba2ca-3549-49a7-be1c-259503a45762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:13.713398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ba2ca-3549-49a7-be1c-259503a45762 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:13.713682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ba2ca-3549-49a7-be1c-259503a45762 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:13.713957 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ba2ca-3549-49a7-be1c-259503a45762 None admin] PATH_INFO: `/v3/users/5c8ad19fd0c84f78930e1175d48a7f50` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:13.715170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ba2ca-3549-49a7-be1c-259503a45762 None admin] RBAC: Authorizing `identity:get_user(user_id=5c8ad19fd0c84f78930e1175d48a7f50)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:13.716685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ba2ca-3549-49a7-be1c-259503a45762 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:13.718644 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 130/262] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:13 2022] GET /identity/v3/users/5c8ad19fd0c84f78930e1175d48a7f50 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:13.724315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ba2ca-3549-49a7-be1c-259503a45762 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:13.828359 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:13.856346 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:13.889786 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441205a-430e-41c0-904e-20058508ad07 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:13.906108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ba2ca-3549-49a7-be1c-259503a45762 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:13.969438 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31036dc1-6c4f-4a16-be1e-2fd89a278ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:13.970347 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31036dc1-6c4f-4a16-be1e-2fd89a278ad9 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:13.970622 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31036dc1-6c4f-4a16-be1e-2fd89a278ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:13.970891 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31036dc1-6c4f-4a16-be1e-2fd89a278ad9 None admin] PATH_INFO: `/v3/users/5c8ad19fd0c84f78930e1175d48a7f50` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:13.972056 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31036dc1-6c4f-4a16-be1e-2fd89a278ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=5c8ad19fd0c84f78930e1175d48a7f50)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:13.973516 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31036dc1-6c4f-4a16-be1e-2fd89a278ad9 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:13.975197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 133/263] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:13 2022] GET /identity/v3/users/5c8ad19fd0c84f78930e1175d48a7f50 => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:13.981617 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31036dc1-6c4f-4a16-be1e-2fd89a278ad9 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:13.982234 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005232b1-0112-4c92-8f93-0f3aef75873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:13.983014 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005232b1-0112-4c92-8f93-0f3aef75873c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:13.983440 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005232b1-0112-4c92-8f93-0f3aef75873c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:13.983894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005232b1-0112-4c92-8f93-0f3aef75873c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:14.102627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005232b1-0112-4c92-8f93-0f3aef75873c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:14.108510 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005232b1-0112-4c92-8f93-0f3aef75873c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:14.145448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31036dc1-6c4f-4a16-be1e-2fd89a278ad9 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:14.227321 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe810c-0a98-498f-9e2c-b5217d87796f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:14.228298 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe810c-0a98-498f-9e2c-b5217d87796f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:14.228714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe810c-0a98-498f-9e2c-b5217d87796f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:14.229191 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe810c-0a98-498f-9e2c-b5217d87796f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:14.236903 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:14.237573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:14.286453 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 131/264] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:14.292930 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005232b1-0112-4c92-8f93-0f3aef75873c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:14.322210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe810c-0a98-498f-9e2c-b5217d87796f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:14.324165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe810c-0a98-498f-9e2c-b5217d87796f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:14.505125 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005232b1-0112-4c92-8f93-0f3aef75873c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:14.570165 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23f8eb-c290-43a5-8e41-a842580417d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:14.570859 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23f8eb-c290-43a5-8e41-a842580417d3 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:14.571147 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23f8eb-c290-43a5-8e41-a842580417d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:14.571416 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23f8eb-c290-43a5-8e41-a842580417d3 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:14.572610 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23f8eb-c290-43a5-8e41-a842580417d3 None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:14.574081 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23f8eb-c290-43a5-8e41-a842580417d3 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:14.575502 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 134/265] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:14.576016 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 132/266] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:14 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:14.585439 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23f8eb-c290-43a5-8e41-a842580417d3 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:14.585631 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe810c-0a98-498f-9e2c-b5217d87796f None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:14.655434 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:14.662970 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:14.790819 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23f8eb-c290-43a5-8e41-a842580417d3 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:14.818312 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe810c-0a98-498f-9e2c-b5217d87796f None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:14.851511 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016e8f3-5c16-41af-b7b6-bf93ddb8f9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:14.852794 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016e8f3-5c16-41af-b7b6-bf93ddb8f9ce None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:14.853069 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016e8f3-5c16-41af-b7b6-bf93ddb8f9ce None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:14.853342 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016e8f3-5c16-41af-b7b6-bf93ddb8f9ce None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:14.858190 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016e8f3-5c16-41af-b7b6-bf93ddb8f9ce None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:14.860046 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016e8f3-5c16-41af-b7b6-bf93ddb8f9ce None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:14.861715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 133/267] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:14 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:14.868599 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016e8f3-5c16-41af-b7b6-bf93ddb8f9ce None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:14.912685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433ef95-9973-45c5-8f25-522c5e1cb19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:14.913745 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433ef95-9973-45c5-8f25-522c5e1cb19e None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:14.914292 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433ef95-9973-45c5-8f25-522c5e1cb19e None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:14.914772 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433ef95-9973-45c5-8f25-522c5e1cb19e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:14.915749 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433ef95-9973-45c5-8f25-522c5e1cb19e None admin] RBAC: Adding query filter params (role.id=035d7eb5fa4e47919e159810a449df68, scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff, user.id=5c8ad19fd0c84f78930e1175d48a7f50) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:14.916298 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433ef95-9973-45c5-8f25-522c5e1cb19e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:14.918317 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433ef95-9973-45c5-8f25-522c5e1cb19e None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:14.930001 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 135/268] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:14 2022] GET /identity/v3/role_assignments?user.id=5c8ad19fd0c84f78930e1175d48a7f50&scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff&role.id=035d7eb5fa4e47919e159810a449df68 => generated 608 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:15.020269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365094-456f-4ca1-9581-33a51dba4e31 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:15.020961 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365094-456f-4ca1-9581-33a51dba4e31 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:15.021348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365094-456f-4ca1-9581-33a51dba4e31 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:15.023156 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 136/269] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:15.029332 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016e8f3-5c16-41af-b7b6-bf93ddb8f9ce None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:15.031198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:15.033766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f31ae0-5468-42be-b3dc-8a8dfa91a23c None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:15.035084 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f31ae0-5468-42be-b3dc-8a8dfa91a23c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:15.035513 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f31ae0-5468-42be-b3dc-8a8dfa91a23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:15.075971 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-69f31ae0-5468-42be-b3dc-8a8dfa91a23c None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:15.077677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-69f31ae0-5468-42be-b3dc-8a8dfa91a23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:15.106737 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b71fb-6f5c-4e05-8d16-1f5f67353674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:15.107636 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b71fb-6f5c-4e05-8d16-1f5f67353674 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:15.108084 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b71fb-6f5c-4e05-8d16-1f5f67353674 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:15.108498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b71fb-6f5c-4e05-8d16-1f5f67353674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:15.109385 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b71fb-6f5c-4e05-8d16-1f5f67353674 None admin] RBAC: Adding query filter params (role.id=81a7cb1c95fd45708dbee5e4dc91626b, scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff, user.id=5c8ad19fd0c84f78930e1175d48a7f50) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:15.109844 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b71fb-6f5c-4e05-8d16-1f5f67353674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:15.112610 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b71fb-6f5c-4e05-8d16-1f5f67353674 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:15.128577 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 134/270] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:14 2022] GET /identity/v3/role_assignments?user.id=5c8ad19fd0c84f78930e1175d48a7f50&scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff&role.id=81a7cb1c95fd45708dbee5e4dc91626b => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:15.194840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 137/271] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:15.218279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7185866-6b05-4f26-be7a-a2e735d91f7a None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:15.218614 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7185866-6b05-4f26-be7a-a2e735d91f7a None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:15.218844 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7185866-6b05-4f26-be7a-a2e735d91f7a None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:15.223027 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 135/272] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:15.227924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e1683-50a0-4a37-8118-59cd04a61043 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:15.228237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e1683-50a0-4a37-8118-59cd04a61043 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:15.228481 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e1683-50a0-4a37-8118-59cd04a61043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:15.252373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-d92e1683-50a0-4a37-8118-59cd04a61043 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:15.253583 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-d92e1683-50a0-4a37-8118-59cd04a61043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:15.281474 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:15.332236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 138/273] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:15.637721 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7185866-6b05-4f26-be7a-a2e735d91f7a None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:15.689486 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e1683-50a0-4a37-8118-59cd04a61043 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:15.788652 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7185866-6b05-4f26-be7a-a2e735d91f7a None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:15.830544 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8131c9-b8cb-4c5e-a272-753392dd77c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:15.831621 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8131c9-b8cb-4c5e-a272-753392dd77c7 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:15.832148 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8131c9-b8cb-4c5e-a272-753392dd77c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:15.832616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8131c9-b8cb-4c5e-a272-753392dd77c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:15.834198 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e1683-50a0-4a37-8118-59cd04a61043 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:15.844476 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8131c9-b8cb-4c5e-a272-753392dd77c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-0a8131c9-b8cb-4c5e-a272-753392dd77c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:15.850127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:15.850998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:15.851818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:15.851818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:15.851818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:15.851818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:15.851818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:15.851818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:15.851818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:15.851818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:15.851818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:15.851818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:15.851818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:15.851818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:15.854559 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 136/274] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:15.861232 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8131c9-b8cb-4c5e-a272-753392dd77c7 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:15.879374 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f4dbd-79d1-444b-9749-cc944419059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:15.880093 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f4dbd-79d1-444b-9749-cc944419059e None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:15.880380 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f4dbd-79d1-444b-9749-cc944419059e None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:15.880835 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f4dbd-79d1-444b-9749-cc944419059e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:15.882236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f4dbd-79d1-444b-9749-cc944419059e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:15.884818 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f4dbd-79d1-444b-9749-cc944419059e None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:15.887875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 139/275] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:15.894110 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f4dbd-79d1-444b-9749-cc944419059e None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:15.904948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:15.928849 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:16.001492 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8131c9-b8cb-4c5e-a272-753392dd77c7 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:16.025235 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f4dbd-79d1-444b-9749-cc944419059e None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:16.043200 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb5086-4bf6-4c42-ace3-8a70c018ca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:16.043877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb5086-4bf6-4c42-ace3-8a70c018ca97 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:16.044156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb5086-4bf6-4c42-ace3-8a70c018ca97 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:16.044444 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb5086-4bf6-4c42-ace3-8a70c018ca97 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:16.045518 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb5086-4bf6-4c42-ace3-8a70c018ca97 None admin] RBAC: Adding query filter params (name=member) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:16.045829 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb5086-4bf6-4c42-ace3-8a70c018ca97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:16.048048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb5086-4bf6-4c42-ace3-8a70c018ca97 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:16.057944 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 137/276] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:16.059016 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b435-5c12-4730-814d-2cc86522bc7b None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:16.059295 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b435-5c12-4730-814d-2cc86522bc7b None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:16.059567 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0b435-5c12-4730-814d-2cc86522bc7b None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:16.060911 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 138/277] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:16.064529 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0b435-5c12-4730-814d-2cc86522bc7b None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:16.070861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba15455-16dc-48cf-a5bc-1839ebb3e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:16.071466 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba15455-16dc-48cf-a5bc-1839ebb3e3bb None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:16.071741 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba15455-16dc-48cf-a5bc-1839ebb3e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:16.072038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba15455-16dc-48cf-a5bc-1839ebb3e3bb None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:16.072673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba15455-16dc-48cf-a5bc-1839ebb3e3bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:16.074452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba15455-16dc-48cf-a5bc-1839ebb3e3bb None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:16.097863 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 140/278] 10.222.0.58 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:15 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:07:16.099463 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e104b8-08fa-4910-bb73-9798c195ba0c None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:16.099754 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e104b8-08fa-4910-bb73-9798c195ba0c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:16.100056 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e104b8-08fa-4910-bb73-9798c195ba0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:16.120091 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-a0e104b8-08fa-4910-bb73-9798c195ba0c None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:16.121321 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-a0e104b8-08fa-4910-bb73-9798c195ba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:16.186179 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:16.202000 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 141/279] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:16.203854 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c72a6-5238-4fcb-8bff-b1e2ff8473b2 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:16.204216 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c72a6-5238-4fcb-8bff-b1e2ff8473b2 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:16.204576 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c72a6-5238-4fcb-8bff-b1e2ff8473b2 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:16.206162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 142/280] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:16.211058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0b435-5c12-4730-814d-2cc86522bc7b None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:16.211951 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc474252-ca7f-44b9-8576-7c85509610b4 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:16.212247 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc474252-ca7f-44b9-8576-7c85509610b4 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:16.212523 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc474252-ca7f-44b9-8576-7c85509610b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:16.236589 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-dc474252-ca7f-44b9-8576-7c85509610b4 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:16.243860 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-dc474252-ca7f-44b9-8576-7c85509610b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:16.251190 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:16.264549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbda28b-0543-4581-b743-8cbbdb42c17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:16.265722 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda28b-0543-4581-b743-8cbbdb42c17a None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:16.266886 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda28b-0543-4581-b743-8cbbdb42c17a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:16.267218 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbda28b-0543-4581-b743-8cbbdb42c17a None admin] PATH_INFO: `/v3/users/39d64af662f44ff6bc16d937bf57d275` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:16.287737 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbda28b-0543-4581-b743-8cbbdb42c17a None admin] RBAC: Authorizing `identity:get_user(user_id=39d64af662f44ff6bc16d937bf57d275)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:16.291779 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbda28b-0543-4581-b743-8cbbdb42c17a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:16.295933 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 139/281] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:16 2022] GET /identity/v3/users/39d64af662f44ff6bc16d937bf57d275 => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:16.300262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbda28b-0543-4581-b743-8cbbdb42c17a None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:16.332278 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 143/282] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:16.430789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbda28b-0543-4581-b743-8cbbdb42c17a None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:16.472976 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d5b75-6d6b-471f-b8ce-41aa9ce2677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:16.473541 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d5b75-6d6b-471f-b8ce-41aa9ce2677a None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:16.473783 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d5b75-6d6b-471f-b8ce-41aa9ce2677a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:16.474056 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d5b75-6d6b-471f-b8ce-41aa9ce2677a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:16.474891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d5b75-6d6b-471f-b8ce-41aa9ce2677a None admin] RBAC: Adding query filter params (role.id=57d5f513f8fd4d7dbd1ef0ecc319892e, user.id=39d64af662f44ff6bc16d937bf57d275, scope.system=all) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:16.475258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d5b75-6d6b-471f-b8ce-41aa9ce2677a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:16.477402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d5b75-6d6b-471f-b8ce-41aa9ce2677a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:16.485766 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 140/283] 10.222.0.58 () {56 vars in 1308 bytes} [Tue Aug 23 22:07:16 2022] GET /identity/v3/role_assignments?user.id=39d64af662f44ff6bc16d937bf57d275&scope.system=all&role.id=57d5f513f8fd4d7dbd1ef0ecc319892e => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:16.559868 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc474252-ca7f-44b9-8576-7c85509610b4 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:16.688321 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc474252-ca7f-44b9-8576-7c85509610b4 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:16.716014 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d5b75-6d6b-471f-b8ce-41aa9ce2677a None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:16.744342 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:16.748694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae069ef-6aab-402b-8177-ed0866d21ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:16.749558 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae069ef-6aab-402b-8177-ed0866d21ef6 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:16.749841 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae069ef-6aab-402b-8177-ed0866d21ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:16.750110 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae069ef-6aab-402b-8177-ed0866d21ef6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:16.765790 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae069ef-6aab-402b-8177-ed0866d21ef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-1ae069ef-6aab-402b-8177-ed0866d21ef6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:16.775399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:16.776341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:16.777105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 144/284] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:16.782248 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae069ef-6aab-402b-8177-ed0866d21ef6 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:16.787002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:16.880346 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d5b75-6d6b-471f-b8ce-41aa9ce2677a None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:16.922654 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04404c45-c0fb-4e3f-8a17-ba99b818f442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:16.923583 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04404c45-c0fb-4e3f-8a17-ba99b818f442 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:16.924318 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04404c45-c0fb-4e3f-8a17-ba99b818f442 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:16.925208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04404c45-c0fb-4e3f-8a17-ba99b818f442 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:16.938574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04404c45-c0fb-4e3f-8a17-ba99b818f442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-04404c45-c0fb-4e3f-8a17-ba99b818f442 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:16.946546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:16.947442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:16.948274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:16.948274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:16.948274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:16.948274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:16.948274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:16.948274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:16.948274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:16.948274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:16.948274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:16.948274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:16.948274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:16.948274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:16.954730 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 141/285] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:16.957230 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04404c45-c0fb-4e3f-8a17-ba99b818f442 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:17.001811 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae069ef-6aab-402b-8177-ed0866d21ef6 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:17.055033 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a943c-8b1d-4e8d-8647-bc6ce72cab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:17.055650 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a943c-8b1d-4e8d-8647-bc6ce72cab4e None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:17.055953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a943c-8b1d-4e8d-8647-bc6ce72cab4e None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:17.056224 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a943c-8b1d-4e8d-8647-bc6ce72cab4e None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:17.056899 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a943c-8b1d-4e8d-8647-bc6ce72cab4e None admin] RBAC: Adding query filter params (name=member) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:17.057200 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a943c-8b1d-4e8d-8647-bc6ce72cab4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:17.058581 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a943c-8b1d-4e8d-8647-bc6ce72cab4e None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:17.078969 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 145/286] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:17.084285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a943c-8b1d-4e8d-8647-bc6ce72cab4e None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:17.104113 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:17.162410 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:17.174985 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04404c45-c0fb-4e3f-8a17-ba99b818f442 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:17.203988 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a943c-8b1d-4e8d-8647-bc6ce72cab4e None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:17.236514 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a677a2e-9436-447b-ba24-e382f2c653de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:17.237477 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a677a2e-9436-447b-ba24-e382f2c653de None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:17.238030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a677a2e-9436-447b-ba24-e382f2c653de None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:17.238501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a677a2e-9436-447b-ba24-e382f2c653de None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:17.239370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a677a2e-9436-447b-ba24-e382f2c653de None admin] RBAC: Adding query filter params (name=reader) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:17.239924 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a677a2e-9436-447b-ba24-e382f2c653de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:17.242304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a677a2e-9436-447b-ba24-e382f2c653de None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:17.256045 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 142/287] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:17.259798 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66932d4a-1543-4fd1-9f32-f0c59ff12244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:17.260058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a677a2e-9436-447b-ba24-e382f2c653de None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:17.261028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66932d4a-1543-4fd1-9f32-f0c59ff12244 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:17.261513 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66932d4a-1543-4fd1-9f32-f0c59ff12244 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:17.261985 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66932d4a-1543-4fd1-9f32-f0c59ff12244 None admin] PATH_INFO: `/v3/users/fe495c7c821543a59dac21f73588c264` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:17.264199 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66932d4a-1543-4fd1-9f32-f0c59ff12244 None admin] RBAC: Authorizing `identity:get_user(user_id=fe495c7c821543a59dac21f73588c264)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:17.267159 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66932d4a-1543-4fd1-9f32-f0c59ff12244 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:17.272954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 146/288] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:17 2022] GET /identity/v3/users/fe495c7c821543a59dac21f73588c264 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:17.277870 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66932d4a-1543-4fd1-9f32-f0c59ff12244 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:17.383274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a677a2e-9436-447b-ba24-e382f2c653de None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:17.415788 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:17.424015 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d74fb-5a7b-41fa-84d8-2c8fe98d5d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:17.425075 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d74fb-5a7b-41fa-84d8-2c8fe98d5d51 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:17.426818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d74fb-5a7b-41fa-84d8-2c8fe98d5d51 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:17.428436 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d74fb-5a7b-41fa-84d8-2c8fe98d5d51 None admin] PATH_INFO: `/v3/users/f2a31e6bfdb240e98c5c617b60a6c100` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:17.430564 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d74fb-5a7b-41fa-84d8-2c8fe98d5d51 None admin] RBAC: Authorizing `identity:get_user(user_id=f2a31e6bfdb240e98c5c617b60a6c100)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:17.432877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d74fb-5a7b-41fa-84d8-2c8fe98d5d51 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:17.434831 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 143/289] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:17 2022] GET /identity/v3/users/f2a31e6bfdb240e98c5c617b60a6c100 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:17.445066 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d74fb-5a7b-41fa-84d8-2c8fe98d5d51 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:17.512025 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66932d4a-1543-4fd1-9f32-f0c59ff12244 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:17.591788 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d74fb-5a7b-41fa-84d8-2c8fe98d5d51 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:17.596906 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:17.613449 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84e2ca-6dd5-4565-a4e9-5a28bff5bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:17.614079 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84e2ca-6dd5-4565-a4e9-5a28bff5bd5f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:17.614366 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84e2ca-6dd5-4565-a4e9-5a28bff5bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:17.614640 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd84e2ca-6dd5-4565-a4e9-5a28bff5bd5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:17.637840 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09104e-5df0-431c-9c08-9fdc5bf5e8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:17.638488 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09104e-5df0-431c-9c08-9fdc5bf5e8e2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:17.638770 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09104e-5df0-431c-9c08-9fdc5bf5e8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:17.639047 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09104e-5df0-431c-9c08-9fdc5bf5e8e2 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:17.640991 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09104e-5df0-431c-9c08-9fdc5bf5e8e2 None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:17.642487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09104e-5df0-431c-9c08-9fdc5bf5e8e2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:17.644615 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 144/290] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:17 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:17.652721 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09104e-5df0-431c-9c08-9fdc5bf5e8e2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:17.728601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:17.764993 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84e2ca-6dd5-4565-a4e9-5a28bff5bd5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:17.767068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd84e2ca-6dd5-4565-a4e9-5a28bff5bd5f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:17.822887 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09104e-5df0-431c-9c08-9fdc5bf5e8e2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:17.896477 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55a935-f321-4915-8753-664cdcb9c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:17.898665 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55a935-f321-4915-8753-664cdcb9c348 None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:17.905126 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55a935-f321-4915-8753-664cdcb9c348 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:17.905784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55a935-f321-4915-8753-664cdcb9c348 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff/users/f2a31e6bfdb240e98c5c617b60a6c100/roles/eefe4f9f49e4401a929ce82b866421d7` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:17.908355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55a935-f321-4915-8753-664cdcb9c348 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b0cf9bc7ac44fb9653e814ea675fff, user_id=f2a31e6bfdb240e98c5c617b60a6c100, role_id=eefe4f9f49e4401a929ce82b866421d7)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:17.910457 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55a935-f321-4915-8753-664cdcb9c348 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:17.936447 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 145/291] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:17 2022] PUT /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff/users/f2a31e6bfdb240e98c5c617b60a6c100/roles/eefe4f9f49e4401a929ce82b866421d7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:17.954687 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 147/292] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:07:17.960925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55a935-f321-4915-8753-664cdcb9c348 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:18.124967 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55a935-f321-4915-8753-664cdcb9c348 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:18.174345 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:18.190346 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddf2a7-18bd-45cb-856a-c565ef5cc839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:18.191356 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddf2a7-18bd-45cb-856a-c565ef5cc839 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:18.191886 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddf2a7-18bd-45cb-856a-c565ef5cc839 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:18.192372 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddf2a7-18bd-45cb-856a-c565ef5cc839 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:18.193858 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddf2a7-18bd-45cb-856a-c565ef5cc839 None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:18.196609 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddf2a7-18bd-45cb-856a-c565ef5cc839 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:18.200591 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 146/293] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:17 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:18.207601 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84e2ca-6dd5-4565-a4e9-5a28bff5bd5f None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:18.251977 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:18.354204 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd84e2ca-6dd5-4565-a4e9-5a28bff5bd5f None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:18.395683 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e0173-3903-4a2b-9d23-725c342f60fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:18.396634 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e0173-3903-4a2b-9d23-725c342f60fd None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:18.397096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e0173-3903-4a2b-9d23-725c342f60fd None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:18.397558 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e0173-3903-4a2b-9d23-725c342f60fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:18.398937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e0173-3903-4a2b-9d23-725c342f60fd None admin] RBAC: Adding query filter params (role.id=57d5f513f8fd4d7dbd1ef0ecc319892e, scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff, user.id=fe495c7c821543a59dac21f73588c264) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:18.399465 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e0173-3903-4a2b-9d23-725c342f60fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:18.402002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e0173-3903-4a2b-9d23-725c342f60fd None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:18.410764 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 148/294] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:18 2022] GET /identity/v3/role_assignments?user.id=fe495c7c821543a59dac21f73588c264&scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff&role.id=57d5f513f8fd4d7dbd1ef0ecc319892e => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:19.004204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00d01c-a493-4d3f-93a0-9f8b1fa932a6 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.004737 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00d01c-a493-4d3f-93a0-9f8b1fa932a6 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.004737 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00d01c-a493-4d3f-93a0-9f8b1fa932a6 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.006124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 147/295] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:19.013571 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada74333-8118-4efa-8622-e0de216d6112 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.014088 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada74333-8118-4efa-8622-e0de216d6112 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.014088 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada74333-8118-4efa-8622-e0de216d6112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.036556 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-ada74333-8118-4efa-8622-e0de216d6112 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:19.037775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-ada74333-8118-4efa-8622-e0de216d6112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:19.129394 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 149/296] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:19.194089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58462b53-29a1-413c-a87f-809f7ba3b6de None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.194393 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58462b53-29a1-413c-a87f-809f7ba3b6de None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.194639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58462b53-29a1-413c-a87f-809f7ba3b6de None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.196828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 148/297] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:19.202177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1242a1-d3f2-4255-bbb6-cf1dd33479b9 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.202467 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1242a1-d3f2-4255-bbb6-cf1dd33479b9 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.202746 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1242a1-d3f2-4255-bbb6-cf1dd33479b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.222924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-aa1242a1-d3f2-4255-bbb6-cf1dd33479b9 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:19.222924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-aa1242a1-d3f2-4255-bbb6-cf1dd33479b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:19.248809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:19.306520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 150/298] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:19.336713 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9be7ad-66b1-465c-a25c-6ff0fac1aa6a None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.337091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9be7ad-66b1-465c-a25c-6ff0fac1aa6a None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.337476 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9be7ad-66b1-465c-a25c-6ff0fac1aa6a None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.339061 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 149/299] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:19.347629 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd23a3-a771-4496-8790-1426d6381061 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.347629 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd23a3-a771-4496-8790-1426d6381061 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.347629 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd23a3-a771-4496-8790-1426d6381061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.366312 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-76cd23a3-a771-4496-8790-1426d6381061 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:19.368551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-76cd23a3-a771-4496-8790-1426d6381061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:19.441808 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 151/300] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:19.515712 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9be7ad-66b1-465c-a25c-6ff0fac1aa6a None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:19.637740 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd23a3-a771-4496-8790-1426d6381061 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:19.639324 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9be7ad-66b1-465c-a25c-6ff0fac1aa6a None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:19.675274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a0ad-64cd-4a76-8466-c7ea2ab371e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:19.675954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a0ad-64cd-4a76-8466-c7ea2ab371e7 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.676243 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a0ad-64cd-4a76-8466-c7ea2ab371e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.676517 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234a0ad-64cd-4a76-8466-c7ea2ab371e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.688462 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5234a0ad-64cd-4a76-8466-c7ea2ab371e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-5234a0ad-64cd-4a76-8466-c7ea2ab371e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:19.693196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:19.694262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:19.695108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 150/301] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:19.700368 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a0ad-64cd-4a76-8466-c7ea2ab371e7 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:19.738007 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:19.750411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd23a3-a771-4496-8790-1426d6381061 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:19.764185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:19.793243 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df583467-63c5-47ad-b427-75e78dfb6096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:19.794096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df583467-63c5-47ad-b427-75e78dfb6096 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.794274 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df583467-63c5-47ad-b427-75e78dfb6096 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.794543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df583467-63c5-47ad-b427-75e78dfb6096 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.795843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df583467-63c5-47ad-b427-75e78dfb6096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:19.797494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df583467-63c5-47ad-b427-75e78dfb6096 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:19.799871 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 152/302] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:19.805085 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df583467-63c5-47ad-b427-75e78dfb6096 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:19.820180 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234a0ad-64cd-4a76-8466-c7ea2ab371e7 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:19.859600 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7362d-65e5-4fbe-a35f-d9de74697f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:19.860239 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7362d-65e5-4fbe-a35f-d9de74697f4e None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.860518 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7362d-65e5-4fbe-a35f-d9de74697f4e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.860792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7362d-65e5-4fbe-a35f-d9de74697f4e None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.861454 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7362d-65e5-4fbe-a35f-d9de74697f4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:19.861758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7362d-65e5-4fbe-a35f-d9de74697f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:19.863132 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7362d-65e5-4fbe-a35f-d9de74697f4e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:19.871815 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 151/303] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:19.872639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7362d-65e5-4fbe-a35f-d9de74697f4e None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:19.913678 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df583467-63c5-47ad-b427-75e78dfb6096 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:19.950905 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f98bc-478a-45a7-a526-2daaa5687e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:19.951506 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f98bc-478a-45a7-a526-2daaa5687e3d None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:19.951786 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f98bc-478a-45a7-a526-2daaa5687e3d None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:19.952086 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f98bc-478a-45a7-a526-2daaa5687e3d None admin] PATH_INFO: `/v3/groups` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:19.952711 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f98bc-478a-45a7-a526-2daaa5687e3d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:19.954139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f98bc-478a-45a7-a526-2daaa5687e3d None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:19.973024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 153/304] 10.222.0.58 () {60 vars in 1134 bytes} [Tue Aug 23 22:07:19 2022] POST /identity/v3/groups => generated 229 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:07:19.973908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f98bc-478a-45a7-a526-2daaa5687e3d None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:19.995873 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7362d-65e5-4fbe-a35f-d9de74697f4e None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:19.996540 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:20.015972 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:20.045163 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1868e-1eb4-4385-be00-baa49291855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:20.045935 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1868e-1eb4-4385-be00-baa49291855f None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.046342 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1868e-1eb4-4385-be00-baa49291855f None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.046694 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1868e-1eb4-4385-be00-baa49291855f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.065586 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1868e-1eb4-4385-be00-baa49291855f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-dbf1868e-1eb4-4385-be00-baa49291855f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:20.072762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:20.073725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:20.074601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:20.074601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:20.074601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:20.074601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:20.074601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:20.074601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:20.074601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:20.074601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:20.074601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:20.074601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:20.074601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:20.074601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:20.077255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 152/305] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:20.087905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1868e-1eb4-4385-be00-baa49291855f None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:20.124932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f98bc-478a-45a7-a526-2daaa5687e3d None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:20.178562 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feec35-ff99-4044-804b-4f643e77a795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:20.178754 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feec35-ff99-4044-804b-4f643e77a795 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.178988 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feec35-ff99-4044-804b-4f643e77a795 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.179260 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feec35-ff99-4044-804b-4f643e77a795 None admin] PATH_INFO: `/v3/users/56ef093ba09140fb814d38e3c7cd7aec` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.198526 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feec35-ff99-4044-804b-4f643e77a795 None admin] RBAC: Authorizing `identity:get_user(user_id=56ef093ba09140fb814d38e3c7cd7aec)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:20.200670 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feec35-ff99-4044-804b-4f643e77a795 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:20.203331 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 154/306] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:19 2022] GET /identity/v3/users/56ef093ba09140fb814d38e3c7cd7aec => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:20.207543 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1868e-1eb4-4385-be00-baa49291855f None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:20.208906 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feec35-ff99-4044-804b-4f643e77a795 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:20.249938 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90438cb5-2ccc-4e49-8201-bb269023d28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:20.250762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90438cb5-2ccc-4e49-8201-bb269023d28b None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.251030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90438cb5-2ccc-4e49-8201-bb269023d28b None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.251298 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90438cb5-2ccc-4e49-8201-bb269023d28b None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.251987 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90438cb5-2ccc-4e49-8201-bb269023d28b None admin] RBAC: Adding query filter params (name=member) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:20.252289 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90438cb5-2ccc-4e49-8201-bb269023d28b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:20.253745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90438cb5-2ccc-4e49-8201-bb269023d28b None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:20.264885 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 153/307] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:20.270272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90438cb5-2ccc-4e49-8201-bb269023d28b None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:20.303455 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:20.314050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:20.341473 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feec35-ff99-4044-804b-4f643e77a795 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:20.375946 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90438cb5-2ccc-4e49-8201-bb269023d28b None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:20.381584 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665bd10-b8f6-47ab-9b37-9ae02130969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:20.382459 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665bd10-b8f6-47ab-9b37-9ae02130969b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.383501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665bd10-b8f6-47ab-9b37-9ae02130969b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.384167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665bd10-b8f6-47ab-9b37-9ae02130969b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.385087 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665bd10-b8f6-47ab-9b37-9ae02130969b None admin] RBAC: Adding query filter params (role.id=eefe4f9f49e4401a929ce82b866421d7, user.id=56ef093ba09140fb814d38e3c7cd7aec, scope.system=all) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:20.385589 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665bd10-b8f6-47ab-9b37-9ae02130969b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:20.387378 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665bd10-b8f6-47ab-9b37-9ae02130969b None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:20.393755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 155/308] 10.222.0.58 () {56 vars in 1308 bytes} [Tue Aug 23 22:07:20 2022] GET /identity/v3/role_assignments?user.id=56ef093ba09140fb814d38e3c7cd7aec&scope.system=all&role.id=eefe4f9f49e4401a929ce82b866421d7 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:20.412524 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda77cf4-968c-46c1-a9f4-a62ea9ab4be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:20.413179 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda77cf4-968c-46c1-a9f4-a62ea9ab4be1 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.413455 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda77cf4-968c-46c1-a9f4-a62ea9ab4be1 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.413730 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda77cf4-968c-46c1-a9f4-a62ea9ab4be1 None admin] PATH_INFO: `/v3/users/39d64af662f44ff6bc16d937bf57d275` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.415256 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda77cf4-968c-46c1-a9f4-a62ea9ab4be1 None admin] RBAC: Authorizing `identity:get_user(user_id=39d64af662f44ff6bc16d937bf57d275)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:20.416803 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda77cf4-968c-46c1-a9f4-a62ea9ab4be1 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:20.418817 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 154/309] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:20 2022] GET /identity/v3/users/39d64af662f44ff6bc16d937bf57d275 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:20.424685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665bd10-b8f6-47ab-9b37-9ae02130969b None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:20.549702 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665bd10-b8f6-47ab-9b37-9ae02130969b None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:20.591121 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f29e3-ac24-4bda-ba56-c1a4a4352fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:20.595518 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f29e3-ac24-4bda-ba56-c1a4a4352fcf None admin] REQUEST_METHOD: `PUT` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.595838 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f29e3-ac24-4bda-ba56-c1a4a4352fcf None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.596120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f29e3-ac24-4bda-ba56-c1a4a4352fcf None admin] PATH_INFO: `/v3/system/users/39d64af662f44ff6bc16d937bf57d275/roles/57d5f513f8fd4d7dbd1ef0ecc319892e` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.597688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f29e3-ac24-4bda-ba56-c1a4a4352fcf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=39d64af662f44ff6bc16d937bf57d275, role_id=57d5f513f8fd4d7dbd1ef0ecc319892e)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:20.599104 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f29e3-ac24-4bda-ba56-c1a4a4352fcf None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:20.604731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:20.611398 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 156/310] 10.222.0.58 () {58 vars in 1334 bytes} [Tue Aug 23 22:07:20 2022] PUT /identity/v3/system/users/39d64af662f44ff6bc16d937bf57d275/roles/57d5f513f8fd4d7dbd1ef0ecc319892e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:20.636448 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44c98e-bd3c-4394-9704-ceba8c90a85b None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.636736 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44c98e-bd3c-4394-9704-ceba8c90a85b None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.637020 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44c98e-bd3c-4394-9704-ceba8c90a85b None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.638814 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 155/311] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:20.644758 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b5227-02a8-4e3f-bce6-fc6b7e884e35 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:20.645349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b5227-02a8-4e3f-bce6-fc6b7e884e35 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:20.645793 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b5227-02a8-4e3f-bce6-fc6b7e884e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:20.667636 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-2b6b5227-02a8-4e3f-bce6-fc6b7e884e35 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:20.669363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-2b6b5227-02a8-4e3f-bce6-fc6b7e884e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:20.748954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 157/312] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:21.088096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44c98e-bd3c-4394-9704-ceba8c90a85b None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.194353 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44c98e-bd3c-4394-9704-ceba8c90a85b None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.205286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:21.233925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711e482-39bd-4740-ab22-2b7dc7e52b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.233925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711e482-39bd-4740-ab22-2b7dc7e52b22 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.233925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711e482-39bd-4740-ab22-2b7dc7e52b22 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.233925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711e482-39bd-4740-ab22-2b7dc7e52b22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.246629 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711e482-39bd-4740-ab22-2b7dc7e52b22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-3711e482-39bd-4740-ab22-2b7dc7e52b22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:21.251355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:21.252241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:21.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 156/313] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:21.259019 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b5227-02a8-4e3f-bce6-fc6b7e884e35 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.368391 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b5227-02a8-4e3f-bce6-fc6b7e884e35 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.400176 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:21.404481 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f7cc-c4f3-4dba-bb83-9e9fec8e3d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.405141 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f7cc-c4f3-4dba-bb83-9e9fec8e3d78 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.405424 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f7cc-c4f3-4dba-bb83-9e9fec8e3d78 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.405697 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384f7cc-c4f3-4dba-bb83-9e9fec8e3d78 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.406352 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384f7cc-c4f3-4dba-bb83-9e9fec8e3d78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:21.406649 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384f7cc-c4f3-4dba-bb83-9e9fec8e3d78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:21.408127 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384f7cc-c4f3-4dba-bb83-9e9fec8e3d78 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:21.416682 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 158/314] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:21.424925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711e482-39bd-4740-ab22-2b7dc7e52b22 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.537385 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711e482-39bd-4740-ab22-2b7dc7e52b22 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.576014 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ac1bf-66b3-4326-b5e8-bad75d8e98f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.576640 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ac1bf-66b3-4326-b5e8-bad75d8e98f6 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.577125 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ac1bf-66b3-4326-b5e8-bad75d8e98f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.577397 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ac1bf-66b3-4326-b5e8-bad75d8e98f6 None admin] PATH_INFO: `/v3/users/f2a31e6bfdb240e98c5c617b60a6c100` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.578558 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ac1bf-66b3-4326-b5e8-bad75d8e98f6 None admin] RBAC: Authorizing `identity:get_user(user_id=f2a31e6bfdb240e98c5c617b60a6c100)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:21.580080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ac1bf-66b3-4326-b5e8-bad75d8e98f6 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:21.581973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 157/315] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/users/f2a31e6bfdb240e98c5c617b60a6c100 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:21.588973 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f7cc-c4f3-4dba-bb83-9e9fec8e3d78 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.699105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384f7cc-c4f3-4dba-bb83-9e9fec8e3d78 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:21.734727 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac594ae4-feec-4e87-bfcc-f20cb8acc6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:21.735335 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594ae4-feec-4e87-bfcc-f20cb8acc6f1 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:21.735620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594ae4-feec-4e87-bfcc-f20cb8acc6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:21.735938 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac594ae4-feec-4e87-bfcc-f20cb8acc6f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:21.803340 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:21.814747 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac594ae4-feec-4e87-bfcc-f20cb8acc6f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:21.816234 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac594ae4-feec-4e87-bfcc-f20cb8acc6f1 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:21.930168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 159/316] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:21.935744 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ac1bf-66b3-4326-b5e8-bad75d8e98f6 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:21.972224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:22.039641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ac1bf-66b3-4326-b5e8-bad75d8e98f6 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:22.073680 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb53366-8f26-49a9-a316-ccc810e5ee53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:22.074310 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb53366-8f26-49a9-a316-ccc810e5ee53 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.074587 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb53366-8f26-49a9-a316-ccc810e5ee53 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.074855 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb53366-8f26-49a9-a316-ccc810e5ee53 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.076005 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb53366-8f26-49a9-a316-ccc810e5ee53 None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:22.077453 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb53366-8f26-49a9-a316-ccc810e5ee53 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:22.079366 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 158/317] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:21 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:22.085222 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac594ae4-feec-4e87-bfcc-f20cb8acc6f1 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:22.180373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:22.189479 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac594ae4-feec-4e87-bfcc-f20cb8acc6f1 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:22.243197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c453b8a-6bc0-44d8-8863-15309fdabf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:22.244201 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453b8a-6bc0-44d8-8863-15309fdabf9f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.244686 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453b8a-6bc0-44d8-8863-15309fdabf9f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.245188 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453b8a-6bc0-44d8-8863-15309fdabf9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.246137 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c453b8a-6bc0-44d8-8863-15309fdabf9f None admin] RBAC: Adding query filter params (role.id=eefe4f9f49e4401a929ce82b866421d7, scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff, user.id=f2a31e6bfdb240e98c5c617b60a6c100) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:22.246644 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c453b8a-6bc0-44d8-8863-15309fdabf9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:22.248344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c453b8a-6bc0-44d8-8863-15309fdabf9f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:22.259871 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 160/318] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:22 2022] GET /identity/v3/role_assignments?user.id=f2a31e6bfdb240e98c5c617b60a6c100&scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff&role.id=eefe4f9f49e4401a929ce82b866421d7 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:22.396614 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bf5ba-91da-4eb1-85de-9fb4af44bb01 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.397159 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bf5ba-91da-4eb1-85de-9fb4af44bb01 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.397159 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bf5ba-91da-4eb1-85de-9fb4af44bb01 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.399299 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 159/319] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:22.405569 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfb824-df33-45b2-8a76-269689988d87 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.406227 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfb824-df33-45b2-8a76-269689988d87 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.406711 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfb824-df33-45b2-8a76-269689988d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.427177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-1fcfb824-df33-45b2-8a76-269689988d87 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:22.428779 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-1fcfb824-df33-45b2-8a76-269689988d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:22.503614 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 161/320] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:22.713106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91749e5-e5a2-47ea-940b-1b458192c2f7 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.713467 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91749e5-e5a2-47ea-940b-1b458192c2f7 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.713666 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91749e5-e5a2-47ea-940b-1b458192c2f7 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.714995 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 160/321] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:22.720506 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b23de6-6877-4eef-9f41-e8fdf17df4f5 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.720796 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b23de6-6877-4eef-9f41-e8fdf17df4f5 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.721066 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b23de6-6877-4eef-9f41-e8fdf17df4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.739555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-75b23de6-6877-4eef-9f41-e8fdf17df4f5 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:22.740771 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-75b23de6-6877-4eef-9f41-e8fdf17df4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:22.810056 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 162/322] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:22.838916 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91749e5-e5a2-47ea-940b-1b458192c2f7 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:22.944839 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91749e5-e5a2-47ea-940b-1b458192c2f7 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:22.948802 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:22.979513 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523fd09-a662-4433-9075-5f0a9c4ad360 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.980044 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523fd09-a662-4433-9075-5f0a9c4ad360 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.980479 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523fd09-a662-4433-9075-5f0a9c4ad360 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.982052 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 163/323] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:22.982343 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc57b80-18f2-448b-a9a9-03be802e4cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:22.982962 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc57b80-18f2-448b-a9a9-03be802e4cec None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.983239 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc57b80-18f2-448b-a9a9-03be802e4cec None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.983507 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc57b80-18f2-448b-a9a9-03be802e4cec None admin] PATH_INFO: `/v3/domains/default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.984637 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc57b80-18f2-448b-a9a9-03be802e4cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:22.986067 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc57b80-18f2-448b-a9a9-03be802e4cec None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:22.987359 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564da899-8553-44c5-9178-4a102eb2200e None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:22.992508 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 161/324] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:22.992680 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564da899-8553-44c5-9178-4a102eb2200e None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:22.992823 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564da899-8553-44c5-9178-4a102eb2200e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:22.993372 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc57b80-18f2-448b-a9a9-03be802e4cec None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.014440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-564da899-8553-44c5-9178-4a102eb2200e None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:23.015677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-564da899-8553-44c5-9178-4a102eb2200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:23.027413 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:23.091350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 164/325] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:23.108480 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc57b80-18f2-448b-a9a9-03be802e4cec None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:23.135211 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564da899-8553-44c5-9178-4a102eb2200e None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.144138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcaad3-bb47-406a-a2a0-8b6087ae379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.145030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcaad3-bb47-406a-a2a0-8b6087ae379c None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.145030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcaad3-bb47-406a-a2a0-8b6087ae379c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.145303 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcaad3-bb47-406a-a2a0-8b6087ae379c None admin] PATH_INFO: `/v3/groups` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.145934 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcaad3-bb47-406a-a2a0-8b6087ae379c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:23.147640 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcaad3-bb47-406a-a2a0-8b6087ae379c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:23.165369 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 162/326] 10.222.0.58 () {60 vars in 1134 bytes} [Tue Aug 23 22:07:22 2022] POST /identity/v3/groups => generated 226 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:23.268670 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564da899-8553-44c5-9178-4a102eb2200e None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:23.308006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762ae32-3049-4b35-80a9-af49d3752c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.308662 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762ae32-3049-4b35-80a9-af49d3752c24 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.308937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762ae32-3049-4b35-80a9-af49d3752c24 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.309209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762ae32-3049-4b35-80a9-af49d3752c24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.321414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762ae32-3049-4b35-80a9-af49d3752c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-b762ae32-3049-4b35-80a9-af49d3752c24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:23.326349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:23.327282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:23.328106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:23.328106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:23.328106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:23.328106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:23.328106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:23.328106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:23.328106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:23.328106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:23.328106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:23.328106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:23.328106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:23.328106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:23.329382 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 165/327] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:23.333407 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcaad3-bb47-406a-a2a0-8b6087ae379c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.370653 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:23.431476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762ae32-3049-4b35-80a9-af49d3752c24 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.444174 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:23.446499 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcaad3-bb47-406a-a2a0-8b6087ae379c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:23.488866 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570d6b5-2238-484c-babc-f1c525228c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.489484 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570d6b5-2238-484c-babc-f1c525228c6b None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.489771 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570d6b5-2238-484c-babc-f1c525228c6b None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.490042 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570d6b5-2238-484c-babc-f1c525228c6b None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.490741 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570d6b5-2238-484c-babc-f1c525228c6b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:23.491056 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570d6b5-2238-484c-babc-f1c525228c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:23.500400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570d6b5-2238-484c-babc-f1c525228c6b None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:23.502759 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 163/328] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:23.511587 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570d6b5-2238-484c-babc-f1c525228c6b None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.567552 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762ae32-3049-4b35-80a9-af49d3752c24 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:23.624362 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecd677-5aad-466d-a6f9-241ef1f94590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.624945 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecd677-5aad-466d-a6f9-241ef1f94590 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.625224 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecd677-5aad-466d-a6f9-241ef1f94590 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.625493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecd677-5aad-466d-a6f9-241ef1f94590 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.645859 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecd677-5aad-466d-a6f9-241ef1f94590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-e6ecd677-5aad-466d-a6f9-241ef1f94590 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:23.653689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:23.654651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:23.655461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 166/329] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:23.660874 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecd677-5aad-466d-a6f9-241ef1f94590 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.676063 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:23.687996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570d6b5-2238-484c-babc-f1c525228c6b None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:23.738229 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259dc5d-b870-4357-a193-86f031ec249c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.738981 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259dc5d-b870-4357-a193-86f031ec249c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.739327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259dc5d-b870-4357-a193-86f031ec249c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.739673 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259dc5d-b870-4357-a193-86f031ec249c None admin] PATH_INFO: `/v3/users/56ef093ba09140fb814d38e3c7cd7aec` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.741202 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259dc5d-b870-4357-a193-86f031ec249c None admin] RBAC: Authorizing `identity:get_user(user_id=56ef093ba09140fb814d38e3c7cd7aec)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:23.743536 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259dc5d-b870-4357-a193-86f031ec249c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:23.746518 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 164/330] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:23 2022] GET /identity/v3/users/56ef093ba09140fb814d38e3c7cd7aec => generated 293 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:23.752272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259dc5d-b870-4357-a193-86f031ec249c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.754614 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:23.796886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecd677-5aad-466d-a6f9-241ef1f94590 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:23.839120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a828af1-702b-4a0c-980f-4205f95628ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.840051 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a828af1-702b-4a0c-980f-4205f95628ab None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.840480 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a828af1-702b-4a0c-980f-4205f95628ab None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.840913 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a828af1-702b-4a0c-980f-4205f95628ab None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.841708 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a828af1-702b-4a0c-980f-4205f95628ab None admin] RBAC: Adding query filter params (name=member) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:23.842156 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a828af1-702b-4a0c-980f-4205f95628ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:23.845177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a828af1-702b-4a0c-980f-4205f95628ab None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:23.855431 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 167/331] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:23.862744 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a828af1-702b-4a0c-980f-4205f95628ab None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:23.875712 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259dc5d-b870-4357-a193-86f031ec249c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:23.930371 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96253e68-fb1d-4574-9c9d-ea5b89e0e3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:23.931589 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96253e68-fb1d-4574-9c9d-ea5b89e0e3dd None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:23.932020 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96253e68-fb1d-4574-9c9d-ea5b89e0e3dd None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:23.932395 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96253e68-fb1d-4574-9c9d-ea5b89e0e3dd None admin] PATH_INFO: `/v3/system/users/56ef093ba09140fb814d38e3c7cd7aec/roles/eefe4f9f49e4401a929ce82b866421d7` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:23.934021 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96253e68-fb1d-4574-9c9d-ea5b89e0e3dd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=56ef093ba09140fb814d38e3c7cd7aec, role_id=eefe4f9f49e4401a929ce82b866421d7)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:23.936126 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96253e68-fb1d-4574-9c9d-ea5b89e0e3dd None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:23.949848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 165/332] 10.222.0.58 () {58 vars in 1334 bytes} [Tue Aug 23 22:07:23 2022] PUT /identity/v3/system/users/56ef093ba09140fb814d38e3c7cd7aec/roles/eefe4f9f49e4401a929ce82b866421d7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:07:23.997010 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a828af1-702b-4a0c-980f-4205f95628ab None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:24.049057 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:24.053252 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ffc2b-02ae-41f0-a5d6-20f2daf18b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:24.053932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ffc2b-02ae-41f0-a5d6-20f2daf18b34 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:24.054213 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ffc2b-02ae-41f0-a5d6-20f2daf18b34 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:24.055373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ffc2b-02ae-41f0-a5d6-20f2daf18b34 None admin] PATH_INFO: `/v3/users/39d64af662f44ff6bc16d937bf57d275` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:24.056806 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ffc2b-02ae-41f0-a5d6-20f2daf18b34 None admin] RBAC: Authorizing `identity:get_user(user_id=39d64af662f44ff6bc16d937bf57d275)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:24.058403 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ffc2b-02ae-41f0-a5d6-20f2daf18b34 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:24.060626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 168/333] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:23 2022] GET /identity/v3/users/39d64af662f44ff6bc16d937bf57d275 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:24.067358 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96253e68-fb1d-4574-9c9d-ea5b89e0e3dd None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:24.106579 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:24.203470 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96253e68-fb1d-4574-9c9d-ea5b89e0e3dd None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:24.251487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae5554-7443-4f72-aeb1-f979c7402de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:24.252124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae5554-7443-4f72-aeb1-f979c7402de1 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:24.252402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae5554-7443-4f72-aeb1-f979c7402de1 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:24.252674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae5554-7443-4f72-aeb1-f979c7402de1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:24.253401 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae5554-7443-4f72-aeb1-f979c7402de1 None admin] RBAC: Adding query filter params (role.id=57d5f513f8fd4d7dbd1ef0ecc319892e, user.id=39d64af662f44ff6bc16d937bf57d275, scope.system=all) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:24.253706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae5554-7443-4f72-aeb1-f979c7402de1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:24.255150 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae5554-7443-4f72-aeb1-f979c7402de1 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:24.273718 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 166/334] 10.222.0.58 () {56 vars in 1308 bytes} [Tue Aug 23 22:07:24 2022] GET /identity/v3/role_assignments?user.id=39d64af662f44ff6bc16d937bf57d275&scope.system=all&role.id=57d5f513f8fd4d7dbd1ef0ecc319892e => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:25.741224 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b9b3a-7b7a-42fc-96c7-7cca3115304c None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:25.742468 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b9b3a-7b7a-42fc-96c7-7cca3115304c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:25.742965 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b9b3a-7b7a-42fc-96c7-7cca3115304c None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:25.744814 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 169/335] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:25.749840 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29f025-577b-40ce-b1c0-fb7237228b5a None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:25.750720 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29f025-577b-40ce-b1c0-fb7237228b5a None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:25.751197 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29f025-577b-40ce-b1c0-fb7237228b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:25.780821 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-3a29f025-577b-40ce-b1c0-fb7237228b5a None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:25.782373 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-3a29f025-577b-40ce-b1c0-fb7237228b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:25.864036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 167/336] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:26.277739 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b9b3a-7b7a-42fc-96c7-7cca3115304c None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:26.399394 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b9b3a-7b7a-42fc-96c7-7cca3115304c None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:26.437090 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a51c-0175-4c72-a1d8-1fc2b4e80e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:26.438157 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a51c-0175-4c72-a1d8-1fc2b4e80e7d None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:26.438649 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a51c-0175-4c72-a1d8-1fc2b4e80e7d None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:26.439114 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760a51c-0175-4c72-a1d8-1fc2b4e80e7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:26.452028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760a51c-0175-4c72-a1d8-1fc2b4e80e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-6760a51c-0175-4c72-a1d8-1fc2b4e80e7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:26.457075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:26.458058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:26.458872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:26.458872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:26.458872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:26.458872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:26.458872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:26.458872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:26.458872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:26.458872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:26.458872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:26.458872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:26.458872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:26.458872 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:26.461844 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ea0a9-77f3-41d4-99ca-aac00362c8af None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:26.462361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ea0a9-77f3-41d4-99ca-aac00362c8af None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:26.462892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ea0a9-77f3-41d4-99ca-aac00362c8af None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:26.464447 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 168/337] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:26.465977 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 170/338] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:26.472372 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99e788-cc06-4b72-8700-ba83ff7bd812 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:26.472939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99e788-cc06-4b72-8700-ba83ff7bd812 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:26.473379 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99e788-cc06-4b72-8700-ba83ff7bd812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:26.477539 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a51c-0175-4c72-a1d8-1fc2b4e80e7d None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:26.518905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-6d99e788-cc06-4b72-8700-ba83ff7bd812 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:26.521224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-6d99e788-cc06-4b72-8700-ba83ff7bd812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:26.541390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:26.630403 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:26.641527 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 169/339] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:26.692594 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760a51c-0175-4c72-a1d8-1fc2b4e80e7d None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:26.735026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c565dd9-27e1-422e-9935-d2ea1faaefa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:26.735995 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c565dd9-27e1-422e-9935-d2ea1faaefa6 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:26.736463 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c565dd9-27e1-422e-9935-d2ea1faaefa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:26.736913 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c565dd9-27e1-422e-9935-d2ea1faaefa6 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:26.737760 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c565dd9-27e1-422e-9935-d2ea1faaefa6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:26.738239 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c565dd9-27e1-422e-9935-d2ea1faaefa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:26.739913 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c565dd9-27e1-422e-9935-d2ea1faaefa6 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:26.749106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 171/340] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:26.755850 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99e788-cc06-4b72-8700-ba83ff7bd812 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:26.877815 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99e788-cc06-4b72-8700-ba83ff7bd812 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:26.923898 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c2040-5ca8-42d4-97d8-db9ab6a43486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:26.924843 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c2040-5ca8-42d4-97d8-db9ab6a43486 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:26.925304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c2040-5ca8-42d4-97d8-db9ab6a43486 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:26.925754 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c2040-5ca8-42d4-97d8-db9ab6a43486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:26.946263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:27.008756 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c2040-5ca8-42d4-97d8-db9ab6a43486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:27.010617 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c2040-5ca8-42d4-97d8-db9ab6a43486 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:27.131586 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 170/341] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:27.138083 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c565dd9-27e1-422e-9935-d2ea1faaefa6 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:27.261850 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c565dd9-27e1-422e-9935-d2ea1faaefa6 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:27.280322 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:27.298442 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a0687-a79a-4c15-b663-5789009e3e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:27.299071 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a0687-a79a-4c15-b663-5789009e3e68 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.299346 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a0687-a79a-4c15-b663-5789009e3e68 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.299616 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a0687-a79a-4c15-b663-5789009e3e68 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.300762 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a0687-a79a-4c15-b663-5789009e3e68 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:27.302209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a0687-a79a-4c15-b663-5789009e3e68 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:27.308236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 172/342] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:27 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:27.309953 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c2040-5ca8-42d4-97d8-db9ab6a43486 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:27.359377 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:27.432794 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c2040-5ca8-42d4-97d8-db9ab6a43486 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:27.464809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a0687-a79a-4c15-b663-5789009e3e68 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:27.488330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0bd73-b207-4c63-94d8-690aea301e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:27.488974 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0bd73-b207-4c63-94d8-690aea301e76 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.489252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0bd73-b207-4c63-94d8-690aea301e76 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.489525 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0bd73-b207-4c63-94d8-690aea301e76 None admin] PATH_INFO: `/v3/groups/ff4c6a284366462c94d732767704ba67` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.502663 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0bd73-b207-4c63-94d8-690aea301e76 None admin] RBAC: Authorizing `identity:get_group(group_id=ff4c6a284366462c94d732767704ba67)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:27.504176 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0bd73-b207-4c63-94d8-690aea301e76 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:27.506161 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 171/343] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:27 2022] GET /identity/v3/groups/ff4c6a284366462c94d732767704ba67 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:27.532905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0bd73-b207-4c63-94d8-690aea301e76 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:27.631609 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a0687-a79a-4c15-b663-5789009e3e68 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:27.692165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebb545-308b-40e1-b31f-620aaa9c9a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:27.692780 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebb545-308b-40e1-b31f-620aaa9c9a1e None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.693063 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebb545-308b-40e1-b31f-620aaa9c9a1e None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.693336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebb545-308b-40e1-b31f-620aaa9c9a1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.716436 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebb545-308b-40e1-b31f-620aaa9c9a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-63ebb545-308b-40e1-b31f-620aaa9c9a1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:27.726639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:27.727570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:27.728435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:27.728435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:27.728435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:27.728435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:27.728435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:27.728435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:27.728435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:27.728435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:27.728435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:27.728435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:27.728435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:27.728435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:27.730545 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 173/344] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:27.746417 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0bd73-b207-4c63-94d8-690aea301e76 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:27.760952 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebb545-308b-40e1-b31f-620aaa9c9a1e None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:27.764188 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:27.800638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cf2b6-55b7-44f3-8bc3-c925beab2ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:27.801256 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cf2b6-55b7-44f3-8bc3-c925beab2ce7 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.801538 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cf2b6-55b7-44f3-8bc3-c925beab2ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.801813 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cf2b6-55b7-44f3-8bc3-c925beab2ce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.802545 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cf2b6-55b7-44f3-8bc3-c925beab2ce7 None admin] RBAC: Adding query filter params (group.id=ff4c6a284366462c94d732767704ba67, role.id=57d5f513f8fd4d7dbd1ef0ecc319892e, scope.project.id=f40ec939fdcc422995f7ce0c3973152d) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:27.802858 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cf2b6-55b7-44f3-8bc3-c925beab2ce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:27.804934 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cf2b6-55b7-44f3-8bc3-c925beab2ce7 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:27.811015 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 172/345] 10.222.0.58 () {56 vars in 1376 bytes} [Tue Aug 23 22:07:27 2022] GET /identity/v3/role_assignments?group.id=ff4c6a284366462c94d732767704ba67&scope.project.id=f40ec939fdcc422995f7ce0c3973152d&role.id=57d5f513f8fd4d7dbd1ef0ecc319892e => generated 260 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:27.812642 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef82d77-4fd5-4704-8f00-6bdfc488be07 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.813097 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef82d77-4fd5-4704-8f00-6bdfc488be07 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.813531 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef82d77-4fd5-4704-8f00-6bdfc488be07 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.815156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 173/346] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:27.820790 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74018877-029c-4b53-8278-8f20041b1e6f None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.821305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74018877-029c-4b53-8278-8f20041b1e6f None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.821944 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74018877-029c-4b53-8278-8f20041b1e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.842739 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-74018877-029c-4b53-8278-8f20041b1e6f None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:27.842936 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:27.844776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-74018877-029c-4b53-8278-8f20041b1e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:27.925168 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 174/347] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:27.926805 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24809ab1-2372-496a-9f78-7428a6a71e0c None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.927293 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24809ab1-2372-496a-9f78-7428a6a71e0c None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.927760 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24809ab1-2372-496a-9f78-7428a6a71e0c None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.930116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 175/348] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:27.936196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f7417-34b2-47f9-acb6-dae7546f2168 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:27.936817 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f7417-34b2-47f9-acb6-dae7546f2168 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:27.937295 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f7417-34b2-47f9-acb6-dae7546f2168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:27.959390 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebb545-308b-40e1-b31f-620aaa9c9a1e None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:27.974842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-0b8f7417-34b2-47f9-acb6-dae7546f2168 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:27.978134 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-0b8f7417-34b2-47f9-acb6-dae7546f2168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:28.026105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965706d-65d3-40f2-8c0e-86aef63bf3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.027406 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965706d-65d3-40f2-8c0e-86aef63bf3f7 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.028010 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965706d-65d3-40f2-8c0e-86aef63bf3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.028500 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965706d-65d3-40f2-8c0e-86aef63bf3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.029387 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965706d-65d3-40f2-8c0e-86aef63bf3f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:28.029891 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965706d-65d3-40f2-8c0e-86aef63bf3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:28.031532 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965706d-65d3-40f2-8c0e-86aef63bf3f7 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:28.047519 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 174/349] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:28.049673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070cce3-1fb8-4703-9fd2-987676de6394 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.050226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070cce3-1fb8-4703-9fd2-987676de6394 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.050707 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070cce3-1fb8-4703-9fd2-987676de6394 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.057529 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 175/350] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:28.060480 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070cce3-1fb8-4703-9fd2-987676de6394 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.136133 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 176/351] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:28.137549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48fdbd-92fe-4948-87cf-e08deeacd6a9 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.137902 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48fdbd-92fe-4948-87cf-e08deeacd6a9 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.138132 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48fdbd-92fe-4948-87cf-e08deeacd6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.159276 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-8f48fdbd-92fe-4948-87cf-e08deeacd6a9 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:28.160617 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-8f48fdbd-92fe-4948-87cf-e08deeacd6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:28.222191 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:28.224731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070cce3-1fb8-4703-9fd2-987676de6394 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.239721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:28.284340 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ea05-cde2-4ed9-a996-f29641b267e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.284960 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ea05-cde2-4ed9-a996-f29641b267e8 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.285237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ea05-cde2-4ed9-a996-f29641b267e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.285506 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4ea05-cde2-4ed9-a996-f29641b267e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.324379 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 177/352] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:28.380608 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4ea05-cde2-4ed9-a996-f29641b267e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:28.382074 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f4ea05-cde2-4ed9-a996-f29641b267e8 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:28.418035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48fdbd-92fe-4948-87cf-e08deeacd6a9 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.509573 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 176/353] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:07:28.517042 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ea05-cde2-4ed9-a996-f29641b267e8 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.529199 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:28.654808 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4ea05-cde2-4ed9-a996-f29641b267e8 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.705960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48fdbd-92fe-4948-87cf-e08deeacd6a9 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.721254 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209ae14-380a-415c-b510-55579e37c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.721902 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209ae14-380a-415c-b510-55579e37c675 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.722182 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209ae14-380a-415c-b510-55579e37c675 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.722455 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209ae14-380a-415c-b510-55579e37c675 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.725968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209ae14-380a-415c-b510-55579e37c675 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:28.727740 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209ae14-380a-415c-b510-55579e37c675 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:28.730152 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 177/354] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:28.735169 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209ae14-380a-415c-b510-55579e37c675 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.767353 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5999-424d-4775-b304-042daf24f752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.768603 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5999-424d-4775-b304-042daf24f752 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.768890 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5999-424d-4775-b304-042daf24f752 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.769166 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad5999-424d-4775-b304-042daf24f752 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.787307 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cad5999-424d-4775-b304-042daf24f752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-2cad5999-424d-4775-b304-042daf24f752 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:28.793263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:28.794185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:28.795040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 178/355] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:28.795814 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5999-424d-4775-b304-042daf24f752 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.824432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:28.848675 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:28.881700 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209ae14-380a-415c-b510-55579e37c675 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.928859 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89deef3f-e1fd-42bf-a328-18a75eee4b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.930418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deef3f-e1fd-42bf-a328-18a75eee4b00 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.930703 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deef3f-e1fd-42bf-a328-18a75eee4b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.930977 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89deef3f-e1fd-42bf-a328-18a75eee4b00 None admin] PATH_INFO: `/v3/groups/ff4c6a284366462c94d732767704ba67` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.932660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad5999-424d-4775-b304-042daf24f752 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:28.933096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89deef3f-e1fd-42bf-a328-18a75eee4b00 None admin] RBAC: Authorizing `identity:get_group(group_id=ff4c6a284366462c94d732767704ba67)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:28.934554 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89deef3f-e1fd-42bf-a328-18a75eee4b00 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:28.936393 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 178/356] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/groups/ff4c6a284366462c94d732767704ba67 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:28.937347 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857414f-1063-4037-8d47-fab787abcc3c None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.937630 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857414f-1063-4037-8d47-fab787abcc3c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.937903 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857414f-1063-4037-8d47-fab787abcc3c None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.939314 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 179/357] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:28.940246 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857414f-1063-4037-8d47-fab787abcc3c None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:28.986623 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b03ec7-570e-49af-8c8c-773651887e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:28.986830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b03ec7-570e-49af-8c8c-773651887e23 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:28.987065 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b03ec7-570e-49af-8c8c-773651887e23 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:28.987286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b03ec7-570e-49af-8c8c-773651887e23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:28.999530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b03ec7-570e-49af-8c8c-773651887e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-46b03ec7-570e-49af-8c8c-773651887e23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:29.006530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:29.008035 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 179/358] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:29.009003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b03ec7-570e-49af-8c8c-773651887e23 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.088340 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857414f-1063-4037-8d47-fab787abcc3c None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.124303 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:29.135119 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5e47f-d638-4967-8033-646690b9ee81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.135738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5e47f-d638-4967-8033-646690b9ee81 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.136060 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5e47f-d638-4967-8033-646690b9ee81 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.136476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5e47f-d638-4967-8033-646690b9ee81 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.137147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5e47f-d638-4967-8033-646690b9ee81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:29.137609 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5e47f-d638-4967-8033-646690b9ee81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.139321 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5e47f-d638-4967-8033-646690b9ee81 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.149858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 180/359] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:29.150686 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5e47f-d638-4967-8033-646690b9ee81 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.151115 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b03ec7-570e-49af-8c8c-773651887e23 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.160816 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:29.198248 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e77f81-8092-4da5-a729-3de79f3f66e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.198880 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e77f81-8092-4da5-a729-3de79f3f66e5 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.199161 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e77f81-8092-4da5-a729-3de79f3f66e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.199435 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e77f81-8092-4da5-a729-3de79f3f66e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.216332 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e77f81-8092-4da5-a729-3de79f3f66e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-54e77f81-8092-4da5-a729-3de79f3f66e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:29.218823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:29.220224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:29.221051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:29.221051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:29.221051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:29.221051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:29.221051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:29.221051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:29.221051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:29.221051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:29.221051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:29.221051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:29.221051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:29.221051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:29.224399 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 180/360] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:29.226083 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0c7f0-0657-4fde-be23-2820d23900be None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.226083 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0c7f0-0657-4fde-be23-2820d23900be None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.226577 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0c7f0-0657-4fde-be23-2820d23900be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.250871 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-11a0c7f0-0657-4fde-be23-2820d23900be None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:29.252277 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-11a0c7f0-0657-4fde-be23-2820d23900be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:29.309215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5e47f-d638-4967-8033-646690b9ee81 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.339187 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 181/361] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:29.340112 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0c7f0-0657-4fde-be23-2820d23900be None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.353509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd63bb0-5e58-4278-8334-f7bc925ae323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.354210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd63bb0-5e58-4278-8334-f7bc925ae323 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.354488 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd63bb0-5e58-4278-8334-f7bc925ae323 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.354755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd63bb0-5e58-4278-8334-f7bc925ae323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.355478 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd63bb0-5e58-4278-8334-f7bc925ae323 None admin] RBAC: Adding query filter params (group.id=ff4c6a284366462c94d732767704ba67, role.id=035d7eb5fa4e47919e159810a449df68, scope.project.id=f40ec939fdcc422995f7ce0c3973152d) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:29.355783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd63bb0-5e58-4278-8334-f7bc925ae323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.357239 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd63bb0-5e58-4278-8334-f7bc925ae323 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.365848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 181/362] 10.222.0.58 () {56 vars in 1376 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/role_assignments?group.id=ff4c6a284366462c94d732767704ba67&scope.project.id=f40ec939fdcc422995f7ce0c3973152d&role.id=035d7eb5fa4e47919e159810a449df68 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:29.370293 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd63bb0-5e58-4278-8334-f7bc925ae323 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.460812 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:29.505013 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0c7f0-0657-4fde-be23-2820d23900be None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.553602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1194-b6b5-4bf0-bec1-00f0670d9286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.554938 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1194-b6b5-4bf0-bec1-00f0670d9286 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.555324 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1194-b6b5-4bf0-bec1-00f0670d9286 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.555709 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e1194-b6b5-4bf0-bec1-00f0670d9286 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.556418 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e1194-b6b5-4bf0-bec1-00f0670d9286 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:29.556716 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e1194-b6b5-4bf0-bec1-00f0670d9286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.558112 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e1194-b6b5-4bf0-bec1-00f0670d9286 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.564864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:29.581445 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 182/363] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:29.584985 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1194-b6b5-4bf0-bec1-00f0670d9286 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.648299 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd63bb0-5e58-4278-8334-f7bc925ae323 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.713574 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67212b-f2c3-4e1c-a837-50b4fb8e960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.714212 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67212b-f2c3-4e1c-a837-50b4fb8e960e None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.714491 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67212b-f2c3-4e1c-a837-50b4fb8e960e None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.714766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67212b-f2c3-4e1c-a837-50b4fb8e960e None admin] PATH_INFO: `/v3/users/56ef093ba09140fb814d38e3c7cd7aec` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.716590 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67212b-f2c3-4e1c-a837-50b4fb8e960e None admin] RBAC: Authorizing `identity:get_user(user_id=56ef093ba09140fb814d38e3c7cd7aec)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.721157 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67212b-f2c3-4e1c-a837-50b4fb8e960e None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.722941 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 182/364] 10.222.0.58 () {56 vars in 1177 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/users/56ef093ba09140fb814d38e3c7cd7aec => generated 293 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:29.723846 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67212b-f2c3-4e1c-a837-50b4fb8e960e None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.769228 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e1194-b6b5-4bf0-bec1-00f0670d9286 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.810328 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6b56-1e47-468e-98c9-d879c2b673ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.811277 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6b56-1e47-468e-98c9-d879c2b673ef None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.811770 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6b56-1e47-468e-98c9-d879c2b673ef None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.812293 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d6b56-1e47-468e-98c9-d879c2b673ef None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.813154 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d6b56-1e47-468e-98c9-d879c2b673ef None admin] RBAC: Adding query filter params (name=member) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:29.813646 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d6b56-1e47-468e-98c9-d879c2b673ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.815398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d6b56-1e47-468e-98c9-d879c2b673ef None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:29.817267 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:29.827926 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 183/365] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:29.829144 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6b56-1e47-468e-98c9-d879c2b673ef None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:29.844965 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67212b-f2c3-4e1c-a837-50b4fb8e960e None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.891471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a668f-8324-41c4-bd07-572e9c60d61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:29.892131 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a668f-8324-41c4-bd07-572e9c60d61c None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:29.892391 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a668f-8324-41c4-bd07-572e9c60d61c None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:29.892647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a668f-8324-41c4-bd07-572e9c60d61c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:29.904018 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:29.978079 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d6b56-1e47-468e-98c9-d879c2b673ef None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:29.978415 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a668f-8324-41c4-bd07-572e9c60d61c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:29.979932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a668f-8324-41c4-bd07-572e9c60d61c None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.027350 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d591-b912-4298-9281-fe9ea3002b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.028390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d591-b912-4298-9281-fe9ea3002b21 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.028877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d591-b912-4298-9281-fe9ea3002b21 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.029343 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d591-b912-4298-9281-fe9ea3002b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.030268 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d591-b912-4298-9281-fe9ea3002b21 None admin] RBAC: Adding query filter params (role.id=eefe4f9f49e4401a929ce82b866421d7, user.id=56ef093ba09140fb814d38e3c7cd7aec, scope.system=all) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:30.031332 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d591-b912-4298-9281-fe9ea3002b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:30.033526 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d591-b912-4298-9281-fe9ea3002b21 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.056211 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 184/366] 10.222.0.58 () {56 vars in 1308 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/role_assignments?user.id=56ef093ba09140fb814d38e3c7cd7aec&scope.system=all&role.id=eefe4f9f49e4401a929ce82b866421d7 => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:30.057577 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d591-b912-4298-9281-fe9ea3002b21 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.111088 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 183/367] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:30.111998 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a668f-8324-41c4-bd07-572e9c60d61c None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.167620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:30.181966 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:30.242723 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a668f-8324-41c4-bd07-572e9c60d61c None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:30.294047 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16a2fa-7ddd-4e96-bab3-64e08d65fd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.294737 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16a2fa-7ddd-4e96-bab3-64e08d65fd3d None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.295019 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16a2fa-7ddd-4e96-bab3-64e08d65fd3d None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.295287 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16a2fa-7ddd-4e96-bab3-64e08d65fd3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.306350 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d591-b912-4298-9281-fe9ea3002b21 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:30.385573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8d0f8-da91-4523-8e75-b2cd91162745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.386219 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8d0f8-da91-4523-8e75-b2cd91162745 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.386501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8d0f8-da91-4523-8e75-b2cd91162745 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.386777 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8d0f8-da91-4523-8e75-b2cd91162745 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.397141 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16a2fa-7ddd-4e96-bab3-64e08d65fd3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:30.399336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16a2fa-7ddd-4e96-bab3-64e08d65fd3d None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.414691 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8d0f8-da91-4523-8e75-b2cd91162745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-cbc8d0f8-da91-4523-8e75-b2cd91162745 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:30.420498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:30.421359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:30.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 185/368] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:30.422795 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8d0f8-da91-4523-8e75-b2cd91162745 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.445706 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:30.552795 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 184/369] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:30.553990 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16a2fa-7ddd-4e96-bab3-64e08d65fd3d None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.571437 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8d0f8-da91-4523-8e75-b2cd91162745 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:30.587192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:30.610603 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa6dbf-e00c-4c9e-945e-a150b65417f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.611252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa6dbf-e00c-4c9e-945e-a150b65417f4 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.611607 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa6dbf-e00c-4c9e-945e-a150b65417f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.611918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa6dbf-e00c-4c9e-945e-a150b65417f4 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.613160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa6dbf-e00c-4c9e-945e-a150b65417f4 None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:30.614650 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa6dbf-e00c-4c9e-945e-a150b65417f4 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.616496 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 186/370] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:30 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:30.618063 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa6dbf-e00c-4c9e-945e-a150b65417f4 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.684692 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16a2fa-7ddd-4e96-bab3-64e08d65fd3d None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:30.721968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e995f23-0a88-4d65-b64c-b3be06e55f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.722634 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e995f23-0a88-4d65-b64c-b3be06e55f8e None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.722920 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e995f23-0a88-4d65-b64c-b3be06e55f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.723191 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e995f23-0a88-4d65-b64c-b3be06e55f8e None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.723988 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e995f23-0a88-4d65-b64c-b3be06e55f8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:30.724395 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e995f23-0a88-4d65-b64c-b3be06e55f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:30.725803 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e995f23-0a88-4d65-b64c-b3be06e55f8e None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.732614 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:30.735567 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa6dbf-e00c-4c9e-945e-a150b65417f4 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:30.739243 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 185/371] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:30.740226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e995f23-0a88-4d65-b64c-b3be06e55f8e None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.780102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677bdf4-12bb-443d-83db-f015edd55806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.780787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677bdf4-12bb-443d-83db-f015edd55806 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.781022 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677bdf4-12bb-443d-83db-f015edd55806 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.781305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677bdf4-12bb-443d-83db-f015edd55806 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.782453 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677bdf4-12bb-443d-83db-f015edd55806 None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:30.783953 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677bdf4-12bb-443d-83db-f015edd55806 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.791016 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 187/372] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:30 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:30.791980 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677bdf4-12bb-443d-83db-f015edd55806 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.849203 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:30.874337 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e995f23-0a88-4d65-b64c-b3be06e55f8e None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:30.922430 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677bdf4-12bb-443d-83db-f015edd55806 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:30.923474 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8265e5a-67b2-440e-a091-c44ecc7dee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.924311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8265e5a-67b2-440e-a091-c44ecc7dee32 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.925384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8265e5a-67b2-440e-a091-c44ecc7dee32 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.925673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8265e5a-67b2-440e-a091-c44ecc7dee32 None admin] PATH_INFO: `/v3/groups/ff4c6a284366462c94d732767704ba67` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:30.926819 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8265e5a-67b2-440e-a091-c44ecc7dee32 None admin] RBAC: Authorizing `identity:get_group(group_id=ff4c6a284366462c94d732767704ba67)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:30.928382 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8265e5a-67b2-440e-a091-c44ecc7dee32 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:30.931604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 186/373] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:30 2022] GET /identity/v3/groups/ff4c6a284366462c94d732767704ba67 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:30.932400 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8265e5a-67b2-440e-a091-c44ecc7dee32 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:30.963261 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb8f8-9cfe-43e5-b742-090dac4a1192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:30.963786 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb8f8-9cfe-43e5-b742-090dac4a1192 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:30.964093 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb8f8-9cfe-43e5-b742-090dac4a1192 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:30.964362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb8f8-9cfe-43e5-b742-090dac4a1192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:31.012447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:31.048636 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eb8f8-9cfe-43e5-b742-090dac4a1192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:31.050121 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61eb8f8-9cfe-43e5-b742-090dac4a1192 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:31.052472 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8265e5a-67b2-440e-a091-c44ecc7dee32 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:31.100502 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1399bc-bd64-4804-a587-94782727c289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:31.101205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1399bc-bd64-4804-a587-94782727c289 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:31.101485 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1399bc-bd64-4804-a587-94782727c289 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:31.101743 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1399bc-bd64-4804-a587-94782727c289 None admin] PATH_INFO: `/v3/groups/ff4c6a284366462c94d732767704ba67` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:31.103933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1399bc-bd64-4804-a587-94782727c289 None admin] RBAC: Authorizing `identity:get_group(group_id=ff4c6a284366462c94d732767704ba67)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:31.105484 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1399bc-bd64-4804-a587-94782727c289 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:31.107073 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 187/374] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:30 2022] GET /identity/v3/groups/ff4c6a284366462c94d732767704ba67 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:31.110171 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf05a50-720b-4ef1-9b29-bb364f637170 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:31.110476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf05a50-720b-4ef1-9b29-bb364f637170 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:31.110742 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf05a50-720b-4ef1-9b29-bb364f637170 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:31.112308 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 188/375] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:31.113080 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf05a50-720b-4ef1-9b29-bb364f637170 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:31.113347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:31.181661 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 188/376] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:31.182608 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb8f8-9cfe-43e5-b742-090dac4a1192 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:31.264265 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf05a50-720b-4ef1-9b29-bb364f637170 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:31.306437 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be619536-47d2-4472-9854-37300afed7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:31.307395 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be619536-47d2-4472-9854-37300afed7f2 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:31.307913 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be619536-47d2-4472-9854-37300afed7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:31.308411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be619536-47d2-4472-9854-37300afed7f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:31.309377 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be619536-47d2-4472-9854-37300afed7f2 None admin] RBAC: Adding query filter params (group.id=ff4c6a284366462c94d732767704ba67, role.id=035d7eb5fa4e47919e159810a449df68, scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:31.309791 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be619536-47d2-4472-9854-37300afed7f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:31.311234 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be619536-47d2-4472-9854-37300afed7f2 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:31.314738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:31.318368 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 189/377] 10.222.0.58 () {56 vars in 1376 bytes} [Tue Aug 23 22:07:31 2022] GET /identity/v3/role_assignments?group.id=ff4c6a284366462c94d732767704ba67&scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff&role.id=035d7eb5fa4e47919e159810a449df68 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:31.319654 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a17b8e-b527-4236-9d77-010bd70b9330 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:31.322174 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a17b8e-b527-4236-9d77-010bd70b9330 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:31.322460 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a17b8e-b527-4236-9d77-010bd70b9330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:31.337277 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb8f8-9cfe-43e5-b742-090dac4a1192 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:31.349163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-29a17b8e-b527-4236-9d77-010bd70b9330 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:31.350431 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-29a17b8e-b527-4236-9d77-010bd70b9330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:31.389466 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf895fe-260e-4fd3-8247-1021467e7f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:31.390473 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf895fe-260e-4fd3-8247-1021467e7f51 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:31.390951 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf895fe-260e-4fd3-8247-1021467e7f51 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:31.391531 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf895fe-260e-4fd3-8247-1021467e7f51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:31.392689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf895fe-260e-4fd3-8247-1021467e7f51 None admin] RBAC: Adding query filter params (group.id=ff4c6a284366462c94d732767704ba67, role.id=57d5f513f8fd4d7dbd1ef0ecc319892e, scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:31.393271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf895fe-260e-4fd3-8247-1021467e7f51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:31.396200 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf895fe-260e-4fd3-8247-1021467e7f51 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:31.405211 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 189/378] 10.222.0.58 () {56 vars in 1376 bytes} [Tue Aug 23 22:07:31 2022] GET /identity/v3/role_assignments?group.id=ff4c6a284366462c94d732767704ba67&scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff&role.id=57d5f513f8fd4d7dbd1ef0ecc319892e => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:31.406478 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf895fe-260e-4fd3-8247-1021467e7f51 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:31.440298 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:31.537163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 190/379] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:31.558414 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf895fe-260e-4fd3-8247-1021467e7f51 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:31.599078 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b3bc-6abb-4d75-8ddf-ab38391fc4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:31.600141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b3bc-6abb-4d75-8ddf-ab38391fc4e4 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:31.600666 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b3bc-6abb-4d75-8ddf-ab38391fc4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:31.601701 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0b3bc-6abb-4d75-8ddf-ab38391fc4e4 None admin] PATH_INFO: `/v3/projects/8dbd689839d74dba96df18fba25139c2` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:31.603216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0b3bc-6abb-4d75-8ddf-ab38391fc4e4 None admin] RBAC: Authorizing `identity:get_project(project_id=8dbd689839d74dba96df18fba25139c2)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:31.605086 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0b3bc-6abb-4d75-8ddf-ab38391fc4e4 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:31.607060 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 190/380] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:31 2022] GET /identity/v3/projects/8dbd689839d74dba96df18fba25139c2 => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:31.615289 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a17b8e-b527-4236-9d77-010bd70b9330 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:31.756100 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a17b8e-b527-4236-9d77-010bd70b9330 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:31.797544 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:31.804221 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c41472-1107-4322-aa5f-f9fe7544923f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:31.805251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c41472-1107-4322-aa5f-f9fe7544923f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:31.805887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c41472-1107-4322-aa5f-f9fe7544923f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:31.806523 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c41472-1107-4322-aa5f-f9fe7544923f None admin] PATH_INFO: `/v3/groups/660d12ea28424e869dfeef023e639fe7` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:31.814267 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c41472-1107-4322-aa5f-f9fe7544923f None admin] RBAC: Authorizing `identity:get_group(group_id=660d12ea28424e869dfeef023e639fe7)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:31.815734 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c41472-1107-4322-aa5f-f9fe7544923f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:31.817401 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 191/381] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:31 2022] GET /identity/v3/groups/660d12ea28424e869dfeef023e639fe7 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:31.823490 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b3bc-6abb-4d75-8ddf-ab38391fc4e4 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:31.936008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:31.962417 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0b3bc-6abb-4d75-8ddf-ab38391fc4e4 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:32.012837 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c41472-1107-4322-aa5f-f9fe7544923f None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:32.015385 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcffb4-a080-4b5f-ae13-046ac790b537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:32.016036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcffb4-a080-4b5f-ae13-046ac790b537 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:32.016317 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcffb4-a080-4b5f-ae13-046ac790b537 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:32.016593 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcffb4-a080-4b5f-ae13-046ac790b537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:32.017324 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcffb4-a080-4b5f-ae13-046ac790b537 None admin] RBAC: Adding query filter params (group.id=660d12ea28424e869dfeef023e639fe7, role.id=81a7cb1c95fd45708dbee5e4dc91626b, scope.project.id=8dbd689839d74dba96df18fba25139c2) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:32.017631 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcffb4-a080-4b5f-ae13-046ac790b537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:32.019060 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcffb4-a080-4b5f-ae13-046ac790b537 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:32.027963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 191/382] 10.222.0.58 () {56 vars in 1376 bytes} [Tue Aug 23 22:07:31 2022] GET /identity/v3/role_assignments?group.id=660d12ea28424e869dfeef023e639fe7&scope.project.id=8dbd689839d74dba96df18fba25139c2&role.id=81a7cb1c95fd45708dbee5e4dc91626b => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:32.154774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c41472-1107-4322-aa5f-f9fe7544923f None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:32.200538 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54324ac3-084e-4dd7-99ec-f96f89faedd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:32.201178 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54324ac3-084e-4dd7-99ec-f96f89faedd7 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:32.201455 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54324ac3-084e-4dd7-99ec-f96f89faedd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:32.201725 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54324ac3-084e-4dd7-99ec-f96f89faedd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:32.221473 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54324ac3-084e-4dd7-99ec-f96f89faedd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-54324ac3-084e-4dd7-99ec-f96f89faedd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:32.229147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:32.230076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:32.230848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 192/383] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:32.237789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcffb4-a080-4b5f-ae13-046ac790b537 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:32.353810 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcffb4-a080-4b5f-ae13-046ac790b537 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:32.362412 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3d1c9-0273-4ca4-b1c5-b46ceb587036 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:32.362688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3d1c9-0273-4ca4-b1c5-b46ceb587036 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:32.362953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3d1c9-0273-4ca4-b1c5-b46ceb587036 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:32.364430 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 193/384] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:32.377408 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f974a3b-b640-4556-a119-dfe76174dc10 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:32.377693 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f974a3b-b640-4556-a119-dfe76174dc10 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:32.377968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f974a3b-b640-4556-a119-dfe76174dc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:32.404306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13057a71-563f-40ea-a516-3ae08832d808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:32.404965 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13057a71-563f-40ea-a516-3ae08832d808 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:32.405189 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13057a71-563f-40ea-a516-3ae08832d808 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:32.405520 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13057a71-563f-40ea-a516-3ae08832d808 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:32.405719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-3f974a3b-b640-4556-a119-dfe76174dc10 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:32.406181 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13057a71-563f-40ea-a516-3ae08832d808 None admin] RBAC: Adding query filter params (name=member) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:32.406480 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13057a71-563f-40ea-a516-3ae08832d808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:32.406944 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-3f974a3b-b640-4556-a119-dfe76174dc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:32.407871 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13057a71-563f-40ea-a516-3ae08832d808 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:32.418607 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 192/385] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:32.423675 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13057a71-563f-40ea-a516-3ae08832d808 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:32.444232 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:32.512487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:32.552549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 194/386] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:32.593871 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13057a71-563f-40ea-a516-3ae08832d808 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:32.643372 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5067d-e08f-43f1-95c6-034b69e3edb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:32.644029 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5067d-e08f-43f1-95c6-034b69e3edb9 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:32.644308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5067d-e08f-43f1-95c6-034b69e3edb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:32.644581 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5067d-e08f-43f1-95c6-034b69e3edb9 None admin] PATH_INFO: `/v3/groups/ff4c6a284366462c94d732767704ba67` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:32.648734 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5067d-e08f-43f1-95c6-034b69e3edb9 None admin] RBAC: Authorizing `identity:get_group(group_id=ff4c6a284366462c94d732767704ba67)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:32.650202 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5067d-e08f-43f1-95c6-034b69e3edb9 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:32.652125 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 193/387] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:32 2022] GET /identity/v3/groups/ff4c6a284366462c94d732767704ba67 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:32.657536 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f974a3b-b640-4556-a119-dfe76174dc10 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:32.794938 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f974a3b-b640-4556-a119-dfe76174dc10 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:32.850338 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7102f9-9ad8-4a12-bb21-5fe1c854194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:32.851615 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7102f9-9ad8-4a12-bb21-5fe1c854194a None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:32.851932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7102f9-9ad8-4a12-bb21-5fe1c854194a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:32.852222 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7102f9-9ad8-4a12-bb21-5fe1c854194a None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:32.856731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7102f9-9ad8-4a12-bb21-5fe1c854194a None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:32.858255 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7102f9-9ad8-4a12-bb21-5fe1c854194a None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:32.860273 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 195/388] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:32 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:32.865958 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5067d-e08f-43f1-95c6-034b69e3edb9 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:32.970055 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:32.997050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5067d-e08f-43f1-95c6-034b69e3edb9 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:33.035232 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7102f9-9ad8-4a12-bb21-5fe1c854194a None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:33.049492 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8399f-923c-4a56-ad59-b021b3a03bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:33.050642 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8399f-923c-4a56-ad59-b021b3a03bc2 None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:33.051144 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8399f-923c-4a56-ad59-b021b3a03bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:33.051606 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8399f-923c-4a56-ad59-b021b3a03bc2 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d/groups/ff4c6a284366462c94d732767704ba67/roles/57d5f513f8fd4d7dbd1ef0ecc319892e` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:33.054645 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8399f-923c-4a56-ad59-b021b3a03bc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f40ec939fdcc422995f7ce0c3973152d, group_id=ff4c6a284366462c94d732767704ba67, role_id=57d5f513f8fd4d7dbd1ef0ecc319892e)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:33.056325 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8399f-923c-4a56-ad59-b021b3a03bc2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:33.084175 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 194/389] 10.222.0.58 () {58 vars in 1442 bytes} [Tue Aug 23 22:07:32 2022] PUT /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d/groups/ff4c6a284366462c94d732767704ba67/roles/57d5f513f8fd4d7dbd1ef0ecc319892e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:33.123903 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:33.195881 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7102f9-9ad8-4a12-bb21-5fe1c854194a None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:33.245543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab55973-58e6-40b2-87bb-0fb5f5e1d7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:33.246227 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab55973-58e6-40b2-87bb-0fb5f5e1d7cb None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:33.246514 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab55973-58e6-40b2-87bb-0fb5f5e1d7cb None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:33.246871 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab55973-58e6-40b2-87bb-0fb5f5e1d7cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:33.268237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab55973-58e6-40b2-87bb-0fb5f5e1d7cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-3ab55973-58e6-40b2-87bb-0fb5f5e1d7cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:33.274425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:33.275439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:33.277115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 196/390] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:33.282985 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8399f-923c-4a56-ad59-b021b3a03bc2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:33.402961 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8399f-923c-4a56-ad59-b021b3a03bc2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:33.443236 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a2f02-80db-417a-b11f-cb948ab4aa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:33.444274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a2f02-80db-417a-b11f-cb948ab4aa13 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:33.445306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a2f02-80db-417a-b11f-cb948ab4aa13 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:33.445899 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a2f02-80db-417a-b11f-cb948ab4aa13 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:33.446776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a2f02-80db-417a-b11f-cb948ab4aa13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:33.447274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a2f02-80db-417a-b11f-cb948ab4aa13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:33.448880 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a2f02-80db-417a-b11f-cb948ab4aa13 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:33.451496 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:33.459348 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 195/391] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:33.465367 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab55973-58e6-40b2-87bb-0fb5f5e1d7cb None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:33.635943 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab55973-58e6-40b2-87bb-0fb5f5e1d7cb None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:33.658127 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:33.686078 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb44189-bef6-4e64-95a4-9351fcb637ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:33.686712 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb44189-bef6-4e64-95a4-9351fcb637ff None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:33.686988 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb44189-bef6-4e64-95a4-9351fcb637ff None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:33.687250 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb44189-bef6-4e64-95a4-9351fcb637ff None admin] PATH_INFO: `/v3/groups/ff4c6a284366462c94d732767704ba67` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:33.688383 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb44189-bef6-4e64-95a4-9351fcb637ff None admin] RBAC: Authorizing `identity:get_group(group_id=ff4c6a284366462c94d732767704ba67)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:33.689817 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb44189-bef6-4e64-95a4-9351fcb637ff None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:33.691748 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 197/392] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:33 2022] GET /identity/v3/groups/ff4c6a284366462c94d732767704ba67 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:33.697724 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a2f02-80db-417a-b11f-cb948ab4aa13 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:33.826454 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a2f02-80db-417a-b11f-cb948ab4aa13 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:33.863673 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426519d-4372-490e-ba4d-1e3dbce21184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:33.864343 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426519d-4372-490e-ba4d-1e3dbce21184 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:33.864625 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426519d-4372-490e-ba4d-1e3dbce21184 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:33.864895 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426519d-4372-490e-ba4d-1e3dbce21184 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:33.866108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426519d-4372-490e-ba4d-1e3dbce21184 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:33.868272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426519d-4372-490e-ba4d-1e3dbce21184 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:33.870236 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 196/393] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:33 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:33.875687 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb44189-bef6-4e64-95a4-9351fcb637ff None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:34.022297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb44189-bef6-4e64-95a4-9351fcb637ff None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:34.063366 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8211d2e-6683-45f3-9b25-8db607ee9953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:34.064143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8211d2e-6683-45f3-9b25-8db607ee9953 None admin] REQUEST_METHOD: `PUT` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.064340 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8211d2e-6683-45f3-9b25-8db607ee9953 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.064617 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8211d2e-6683-45f3-9b25-8db607ee9953 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d/groups/ff4c6a284366462c94d732767704ba67/roles/035d7eb5fa4e47919e159810a449df68` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.069672 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8211d2e-6683-45f3-9b25-8db607ee9953 None admin] RBAC: Authorizing `identity:create_grant(project_id=f40ec939fdcc422995f7ce0c3973152d, group_id=ff4c6a284366462c94d732767704ba67, role_id=035d7eb5fa4e47919e159810a449df68)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:34.071131 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8211d2e-6683-45f3-9b25-8db607ee9953 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:34.097249 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 198/394] 10.222.0.58 () {58 vars in 1442 bytes} [Tue Aug 23 22:07:33 2022] PUT /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d/groups/ff4c6a284366462c94d732767704ba67/roles/035d7eb5fa4e47919e159810a449df68 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:34.182352 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c67e99-b838-469e-841e-a9e0b021837e None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.182701 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c67e99-b838-469e-841e-a9e0b021837e None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.182920 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c67e99-b838-469e-841e-a9e0b021837e None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.184514 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 197/395] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:34.189679 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3743c1d-ae8e-4ec0-ac6f-19db33a4d87c None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.189972 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3743c1d-ae8e-4ec0-ac6f-19db33a4d87c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.190250 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3743c1d-ae8e-4ec0-ac6f-19db33a4d87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.221077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-b3743c1d-ae8e-4ec0-ac6f-19db33a4d87c None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:34.222342 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-b3743c1d-ae8e-4ec0-ac6f-19db33a4d87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:34.280104 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:34.329886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 199/396] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:34.437198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c74fe-a8a4-4515-b8a0-de71dac147b8 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.437516 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c74fe-a8a4-4515-b8a0-de71dac147b8 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.437772 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c74fe-a8a4-4515-b8a0-de71dac147b8 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.439396 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 198/397] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:34.448634 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c05818-b3e1-4506-a93b-e64cb1ab3ef2 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.448926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c05818-b3e1-4506-a93b-e64cb1ab3ef2 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.449208 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c05818-b3e1-4506-a93b-e64cb1ab3ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.470717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-29c05818-b3e1-4506-a93b-e64cb1ab3ef2 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:34.471955 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-29c05818-b3e1-4506-a93b-e64cb1ab3ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:34.562055 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 200/398] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:34.742126 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c74fe-a8a4-4515-b8a0-de71dac147b8 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:34.823310 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:34.865803 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c74fe-a8a4-4515-b8a0-de71dac147b8 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:34.903142 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ccf7a3-2be3-4fc0-9af2-947059676b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:34.903901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccf7a3-2be3-4fc0-9af2-947059676b8b None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:34.904127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccf7a3-2be3-4fc0-9af2-947059676b8b None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:34.904445 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccf7a3-2be3-4fc0-9af2-947059676b8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:34.914932 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ccf7a3-2be3-4fc0-9af2-947059676b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-77ccf7a3-2be3-4fc0-9af2-947059676b8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:34.920808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:34.921703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:34.922487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:34.922487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:34.922487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:34.922487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:34.922487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:34.922487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:34.922487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:34.922487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:34.922487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:34.922487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:34.922487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:34.922487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:34.926514 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 199/399] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:34.932921 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c05818-b3e1-4506-a93b-e64cb1ab3ef2 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:34.995722 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ccf7a3-2be3-4fc0-9af2-947059676b8b None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.055231 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:35.058621 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c05818-b3e1-4506-a93b-e64cb1ab3ef2 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:35.097494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c113d-ed62-4b3f-8df9-7b794eb98948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:35.098111 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c113d-ed62-4b3f-8df9-7b794eb98948 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.098399 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c113d-ed62-4b3f-8df9-7b794eb98948 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.098683 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c113d-ed62-4b3f-8df9-7b794eb98948 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.099353 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c113d-ed62-4b3f-8df9-7b794eb98948 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:35.099659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c113d-ed62-4b3f-8df9-7b794eb98948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:35.101242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c113d-ed62-4b3f-8df9-7b794eb98948 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:35.110148 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 201/400] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:35.111450 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bce44-b3d2-4742-b339-2e542a015147 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.111744 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bce44-b3d2-4742-b339-2e542a015147 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.112042 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bce44-b3d2-4742-b339-2e542a015147 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.113482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 202/401] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:35.115885 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bce44-b3d2-4742-b339-2e542a015147 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.129997 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ccf7a3-2be3-4fc0-9af2-947059676b8b None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:35.159174 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:35.169449 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa6e8e-7bba-4994-bfef-fcc053b2585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:35.170251 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa6e8e-7bba-4994-bfef-fcc053b2585e None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.170601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa6e8e-7bba-4994-bfef-fcc053b2585e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.171044 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa6e8e-7bba-4994-bfef-fcc053b2585e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.183063 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa6e8e-7bba-4994-bfef-fcc053b2585e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-9aaa6e8e-7bba-4994-bfef-fcc053b2585e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:35.188432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:35.190208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 200/402] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:35.192320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511c417-ff9a-4cd8-baef-de1406795217 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.194042 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511c417-ff9a-4cd8-baef-de1406795217 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.194042 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511c417-ff9a-4cd8-baef-de1406795217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.212092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-c511c417-ff9a-4cd8-baef-de1406795217 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:35.213306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-c511c417-ff9a-4cd8-baef-de1406795217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:35.236740 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bce44-b3d2-4742-b339-2e542a015147 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:35.286790 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03bbbe-2d6a-4d7b-a198-939d8c12cbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:35.288795 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03bbbe-2d6a-4d7b-a198-939d8c12cbfd None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.289530 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03bbbe-2d6a-4d7b-a198-939d8c12cbfd None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.289979 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03bbbe-2d6a-4d7b-a198-939d8c12cbfd None admin] PATH_INFO: `/v3/groups/ff4c6a284366462c94d732767704ba67` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.291744 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03bbbe-2d6a-4d7b-a198-939d8c12cbfd None admin] RBAC: Authorizing `identity:get_group(group_id=ff4c6a284366462c94d732767704ba67)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:35.293964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03bbbe-2d6a-4d7b-a198-939d8c12cbfd None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:35.300592 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 203/403] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:35 2022] GET /identity/v3/groups/ff4c6a284366462c94d732767704ba67 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:35.301383 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03bbbe-2d6a-4d7b-a198-939d8c12cbfd None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.319874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 201/404] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:35.319874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511c417-ff9a-4cd8-baef-de1406795217 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.376276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:35.463715 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03bbbe-2d6a-4d7b-a198-939d8c12cbfd None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:35.468792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511c417-ff9a-4cd8-baef-de1406795217 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:35.487851 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:35.508746 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771fc68-38c5-4904-9b8f-5542d1b1c4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:35.509751 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771fc68-38c5-4904-9b8f-5542d1b1c4e1 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.510230 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771fc68-38c5-4904-9b8f-5542d1b1c4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.510781 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771fc68-38c5-4904-9b8f-5542d1b1c4e1 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.512460 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771fc68-38c5-4904-9b8f-5542d1b1c4e1 None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:35.514101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771fc68-38c5-4904-9b8f-5542d1b1c4e1 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:35.515963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 202/405] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:35 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:35.517428 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebefc01-cd73-44e3-8ea1-dcf42616f997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:35.518049 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebefc01-cd73-44e3-8ea1-dcf42616f997 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.518337 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebefc01-cd73-44e3-8ea1-dcf42616f997 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.518612 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebefc01-cd73-44e3-8ea1-dcf42616f997 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.519285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebefc01-cd73-44e3-8ea1-dcf42616f997 None admin] RBAC: Adding query filter params (name=member) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:35.519591 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebefc01-cd73-44e3-8ea1-dcf42616f997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:35.523922 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebefc01-cd73-44e3-8ea1-dcf42616f997 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:35.525100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771fc68-38c5-4904-9b8f-5542d1b1c4e1 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.535873 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 204/406] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:35.536772 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebefc01-cd73-44e3-8ea1-dcf42616f997 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.647211 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebefc01-cd73-44e3-8ea1-dcf42616f997 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:35.660227 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:35.684604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22c01b-f716-4d81-89bd-3366db5bd5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:35.685304 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22c01b-f716-4d81-89bd-3366db5bd5b3 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.685596 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22c01b-f716-4d81-89bd-3366db5bd5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.685877 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22c01b-f716-4d81-89bd-3366db5bd5b3 None admin] PATH_INFO: `/v3/groups/ff4c6a284366462c94d732767704ba67` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.687331 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22c01b-f716-4d81-89bd-3366db5bd5b3 None admin] RBAC: Authorizing `identity:get_group(group_id=ff4c6a284366462c94d732767704ba67)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:35.688838 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22c01b-f716-4d81-89bd-3366db5bd5b3 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:35.690883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 205/407] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:35 2022] GET /identity/v3/groups/ff4c6a284366462c94d732767704ba67 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:35.697270 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22c01b-f716-4d81-89bd-3366db5bd5b3 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.746227 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771fc68-38c5-4904-9b8f-5542d1b1c4e1 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:35.809011 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22c01b-f716-4d81-89bd-3366db5bd5b3 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:35.812420 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127ab56-6947-4473-afc5-8519115e188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:35.813083 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127ab56-6947-4473-afc5-8519115e188e None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.813366 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127ab56-6947-4473-afc5-8519115e188e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.813641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127ab56-6947-4473-afc5-8519115e188e None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff/groups/ff4c6a284366462c94d732767704ba67/roles/035d7eb5fa4e47919e159810a449df68` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.817611 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127ab56-6947-4473-afc5-8519115e188e None admin] RBAC: Authorizing `identity:create_grant(project_id=55b0cf9bc7ac44fb9653e814ea675fff, group_id=ff4c6a284366462c94d732767704ba67, role_id=035d7eb5fa4e47919e159810a449df68)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:35.820446 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127ab56-6947-4473-afc5-8519115e188e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:35.841206 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 203/408] 10.222.0.58 () {58 vars in 1442 bytes} [Tue Aug 23 22:07:35 2022] PUT /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff/groups/ff4c6a284366462c94d732767704ba67/roles/035d7eb5fa4e47919e159810a449df68 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:35.842842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127ab56-6947-4473-afc5-8519115e188e None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.851736 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e385b-5ed0-46ae-8345-4a88c601f405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:35.852545 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e385b-5ed0-46ae-8345-4a88c601f405 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:35.852831 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e385b-5ed0-46ae-8345-4a88c601f405 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:35.853104 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e385b-5ed0-46ae-8345-4a88c601f405 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:35.854450 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e385b-5ed0-46ae-8345-4a88c601f405 None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:35.856240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e385b-5ed0-46ae-8345-4a88c601f405 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:35.858989 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 206/409] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:35 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:35.864664 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e385b-5ed0-46ae-8345-4a88c601f405 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:35.904269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:35.917601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:35.997649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127ab56-6947-4473-afc5-8519115e188e None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:36.036494 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769026d-202b-4463-9c32-f753059ce242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:36.037614 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769026d-202b-4463-9c32-f753059ce242 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:36.038199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769026d-202b-4463-9c32-f753059ce242 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:36.038882 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769026d-202b-4463-9c32-f753059ce242 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:36.050965 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769026d-202b-4463-9c32-f753059ce242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-8769026d-202b-4463-9c32-f753059ce242 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:36.057582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:36.058572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:36.059378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:36.059378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:36.059378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:36.059378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:36.059378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:36.059378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:36.059378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:36.059378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:36.059378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:36.059378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:36.059378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:36.059378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:36.062110 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 204/410] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:36.067860 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d2035-658d-4c1a-add4-682d43478685 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:36.068519 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d2035-658d-4c1a-add4-682d43478685 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:36.069069 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d2035-658d-4c1a-add4-682d43478685 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:36.072268 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 205/411] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:36.073323 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d2035-658d-4c1a-add4-682d43478685 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:36.118370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e385b-5ed0-46ae-8345-4a88c601f405 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:36.154173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4635b-5126-42a5-bf68-702207e747d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:36.154896 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4635b-5126-42a5-bf68-702207e747d7 None admin] REQUEST_METHOD: `PUT` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:36.155123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4635b-5126-42a5-bf68-702207e747d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:36.155402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4635b-5126-42a5-bf68-702207e747d7 None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff/groups/ff4c6a284366462c94d732767704ba67/roles/57d5f513f8fd4d7dbd1ef0ecc319892e` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:36.157446 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4635b-5126-42a5-bf68-702207e747d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=55b0cf9bc7ac44fb9653e814ea675fff, group_id=ff4c6a284366462c94d732767704ba67, role_id=57d5f513f8fd4d7dbd1ef0ecc319892e)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:36.159114 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4635b-5126-42a5-bf68-702207e747d7 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:36.191188 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 207/412] 10.222.0.58 () {58 vars in 1442 bytes} [Tue Aug 23 22:07:35 2022] PUT /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff/groups/ff4c6a284366462c94d732767704ba67/roles/57d5f513f8fd4d7dbd1ef0ecc319892e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:07:36.193634 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9433578-09b8-4c8e-b769-c64789398d62 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:36.193634 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9433578-09b8-4c8e-b769-c64789398d62 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:36.193634 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9433578-09b8-4c8e-b769-c64789398d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:36.222919 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-d9433578-09b8-4c8e-b769-c64789398d62 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:36.222919 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-d9433578-09b8-4c8e-b769-c64789398d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:36.240916 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d2035-658d-4c1a-add4-682d43478685 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:36.244958 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:36.340475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 208/413] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:36.364220 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ecab2-db43-41ba-9609-10c815fddcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:36.364847 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ecab2-db43-41ba-9609-10c815fddcf7 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:36.365121 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ecab2-db43-41ba-9609-10c815fddcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:36.365392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ecab2-db43-41ba-9609-10c815fddcf7 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:36.366065 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ecab2-db43-41ba-9609-10c815fddcf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:36.369951 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ecab2-db43-41ba-9609-10c815fddcf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:36.369951 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ecab2-db43-41ba-9609-10c815fddcf7 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:36.385852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 206/414] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:36.391739 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9433578-09b8-4c8e-b769-c64789398d62 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:36.432461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:36.595805 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9433578-09b8-4c8e-b769-c64789398d62 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:36.654050 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b1e3-8d8a-4c46-af7a-d76eb3a57c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:36.654690 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b1e3-8d8a-4c46-af7a-d76eb3a57c2f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:36.654972 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b1e3-8d8a-4c46-af7a-d76eb3a57c2f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:36.655243 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b1e3-8d8a-4c46-af7a-d76eb3a57c2f None admin] PATH_INFO: `/v3/groups/660d12ea28424e869dfeef023e639fe7` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:36.660503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467b1e3-8d8a-4c46-af7a-d76eb3a57c2f None admin] RBAC: Authorizing `identity:get_group(group_id=660d12ea28424e869dfeef023e639fe7)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:36.661950 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467b1e3-8d8a-4c46-af7a-d76eb3a57c2f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:36.664264 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 209/415] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:36 2022] GET /identity/v3/groups/660d12ea28424e869dfeef023e639fe7 => generated 229 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:36.669839 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ecab2-db43-41ba-9609-10c815fddcf7 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:36.712376 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b1e3-8d8a-4c46-af7a-d76eb3a57c2f None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:36.789762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ecab2-db43-41ba-9609-10c815fddcf7 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:36.826514 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024981b-87c3-46b8-b36d-aeef7bcc86c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:36.827151 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024981b-87c3-46b8-b36d-aeef7bcc86c9 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:36.827428 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024981b-87c3-46b8-b36d-aeef7bcc86c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:36.827696 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024981b-87c3-46b8-b36d-aeef7bcc86c9 None admin] PATH_INFO: `/v3/projects/8dbd689839d74dba96df18fba25139c2` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:36.828899 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024981b-87c3-46b8-b36d-aeef7bcc86c9 None admin] RBAC: Authorizing `identity:get_project(project_id=8dbd689839d74dba96df18fba25139c2)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:36.830333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024981b-87c3-46b8-b36d-aeef7bcc86c9 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:36.832318 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 207/416] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:36 2022] GET /identity/v3/projects/8dbd689839d74dba96df18fba25139c2 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:36.839731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024981b-87c3-46b8-b36d-aeef7bcc86c9 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:36.887116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:36.967099 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024981b-87c3-46b8-b36d-aeef7bcc86c9 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:36.984200 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:37.004374 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b1e3-8d8a-4c46-af7a-d76eb3a57c2f None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:37.016290 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cee0c9-cbf3-41b0-bc60-8044a803b83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:37.016956 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cee0c9-cbf3-41b0-bc60-8044a803b83e None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.017238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cee0c9-cbf3-41b0-bc60-8044a803b83e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.017519 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cee0c9-cbf3-41b0-bc60-8044a803b83e None admin] PATH_INFO: `/v3/projects/8dbd689839d74dba96df18fba25139c2/groups/660d12ea28424e869dfeef023e639fe7/roles/81a7cb1c95fd45708dbee5e4dc91626b` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.019628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cee0c9-cbf3-41b0-bc60-8044a803b83e None admin] RBAC: Authorizing `identity:create_grant(project_id=8dbd689839d74dba96df18fba25139c2, group_id=660d12ea28424e869dfeef023e639fe7, role_id=81a7cb1c95fd45708dbee5e4dc91626b)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:37.021150 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cee0c9-cbf3-41b0-bc60-8044a803b83e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:37.037034 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 208/417] 10.222.0.58 () {58 vars in 1442 bytes} [Tue Aug 23 22:07:36 2022] PUT /identity/v3/projects/8dbd689839d74dba96df18fba25139c2/groups/660d12ea28424e869dfeef023e639fe7/roles/81a7cb1c95fd45708dbee5e4dc91626b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:37.039197 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645e75a-3419-404c-bb39-42eac40b76ba None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.039484 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645e75a-3419-404c-bb39-42eac40b76ba None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.039904 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645e75a-3419-404c-bb39-42eac40b76ba None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.041347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 209/418] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:37.044846 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fddbe8-6e8c-469e-bcb7-fb8d578775f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:37.045439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fddbe8-6e8c-469e-bcb7-fb8d578775f2 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.045718 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fddbe8-6e8c-469e-bcb7-fb8d578775f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.045994 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fddbe8-6e8c-469e-bcb7-fb8d578775f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.047521 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dac27-b266-4ee1-a618-f9bcdc131a50 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.048235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dac27-b266-4ee1-a618-f9bcdc131a50 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.048653 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dac27-b266-4ee1-a618-f9bcdc131a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.058479 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fddbe8-6e8c-469e-bcb7-fb8d578775f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-f6fddbe8-6e8c-469e-bcb7-fb8d578775f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:37.063933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:37.064932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:37.066207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 210/419] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:37.073099 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-7d7dac27-b266-4ee1-a618-f9bcdc131a50 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:37.074678 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-7d7dac27-b266-4ee1-a618-f9bcdc131a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:37.076927 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fddbe8-6e8c-469e-bcb7-fb8d578775f2 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:37.166698 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 210/420] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:37.229151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fddbe8-6e8c-469e-bcb7-fb8d578775f2 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:37.265262 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c367de2-7453-47c6-b4fb-5dc7981e8943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:37.265866 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c367de2-7453-47c6-b4fb-5dc7981e8943 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.266142 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c367de2-7453-47c6-b4fb-5dc7981e8943 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.266413 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c367de2-7453-47c6-b4fb-5dc7981e8943 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.267073 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c367de2-7453-47c6-b4fb-5dc7981e8943 None admin] RBAC: Adding query filter params (name=member) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:37.267372 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c367de2-7453-47c6-b4fb-5dc7981e8943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:37.268769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c367de2-7453-47c6-b4fb-5dc7981e8943 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:37.277958 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 211/421] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:37.283271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dac27-b266-4ee1-a618-f9bcdc131a50 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:37.310106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:37.389817 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dac27-b266-4ee1-a618-f9bcdc131a50 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:37.439600 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4549e8f-d57d-43d8-bd11-b0dab1b6695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:37.440392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4549e8f-d57d-43d8-bd11-b0dab1b6695e None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.440811 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4549e8f-d57d-43d8-bd11-b0dab1b6695e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.441177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4549e8f-d57d-43d8-bd11-b0dab1b6695e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.536862 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4549e8f-d57d-43d8-bd11-b0dab1b6695e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:37.538963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4549e8f-d57d-43d8-bd11-b0dab1b6695e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:37.566336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c367de2-7453-47c6-b4fb-5dc7981e8943 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:37.576015 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:37.587538 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:37.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c367de2-7453-47c6-b4fb-5dc7981e8943 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:37.724580 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 211/422] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:07:37.731017 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4549e8f-d57d-43d8-bd11-b0dab1b6695e None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:37.749621 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a66d5-f9b0-4eb7-bb37-f0dd8605fc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:37.750429 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a66d5-f9b0-4eb7-bb37-f0dd8605fc14 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.750903 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a66d5-f9b0-4eb7-bb37-f0dd8605fc14 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.751273 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a66d5-f9b0-4eb7-bb37-f0dd8605fc14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.776825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a66d5-f9b0-4eb7-bb37-f0dd8605fc14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-236a66d5-f9b0-4eb7-bb37-f0dd8605fc14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:37.786766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:37.787878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:37.789783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:37.789783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:37.789783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:37.789783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:37.789783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:37.789783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:37.789783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:37.789783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:37.789783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:37.789783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:37.789783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:37.789783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:37.793348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 212/423] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:37.799200 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a66d5-f9b0-4eb7-bb37-f0dd8605fc14 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:37.877893 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4549e8f-d57d-43d8-bd11-b0dab1b6695e None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:37.911359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:37.926643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec8af8-5fd8-47d2-98c2-af742dc23098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:37.928170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec8af8-5fd8-47d2-98c2-af742dc23098 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:37.928561 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec8af8-5fd8-47d2-98c2-af742dc23098 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:37.930186 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec8af8-5fd8-47d2-98c2-af742dc23098 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:37.931553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec8af8-5fd8-47d2-98c2-af742dc23098 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:37.933248 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec8af8-5fd8-47d2-98c2-af742dc23098 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:37.937169 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 212/424] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:37 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:37.941106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec8af8-5fd8-47d2-98c2-af742dc23098 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:37.976764 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:38.066096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a66d5-f9b0-4eb7-bb37-f0dd8605fc14 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:38.091816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec8af8-5fd8-47d2-98c2-af742dc23098 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:38.145785 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5503505-c67e-4cce-9d4c-ef66225f6c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:38.146425 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5503505-c67e-4cce-9d4c-ef66225f6c67 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.146711 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5503505-c67e-4cce-9d4c-ef66225f6c67 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.146988 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5503505-c67e-4cce-9d4c-ef66225f6c67 None admin] PATH_INFO: `/v3/groups/ff4c6a284366462c94d732767704ba67` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.149166 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5503505-c67e-4cce-9d4c-ef66225f6c67 None admin] RBAC: Authorizing `identity:get_group(group_id=ff4c6a284366462c94d732767704ba67)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:38.151610 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5503505-c67e-4cce-9d4c-ef66225f6c67 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:38.153952 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f916e07-4db8-4e95-90cf-11cb19cbbf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:38.154568 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f916e07-4db8-4e95-90cf-11cb19cbbf9b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.154854 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f916e07-4db8-4e95-90cf-11cb19cbbf9b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.155289 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f916e07-4db8-4e95-90cf-11cb19cbbf9b None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.155992 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f916e07-4db8-4e95-90cf-11cb19cbbf9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:38.156299 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f916e07-4db8-4e95-90cf-11cb19cbbf9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:38.157663 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f916e07-4db8-4e95-90cf-11cb19cbbf9b None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:38.159480 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 213/425] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:37 2022] GET /identity/v3/groups/ff4c6a284366462c94d732767704ba67 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:38.160333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5503505-c67e-4cce-9d4c-ef66225f6c67 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:38.176951 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 213/426] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:38.183468 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f916e07-4db8-4e95-90cf-11cb19cbbf9b None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:38.309583 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f916e07-4db8-4e95-90cf-11cb19cbbf9b None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:38.321319 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:38.344970 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:38.353382 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299036-be6f-4223-9f5f-fc50e50c807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:38.354001 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299036-be6f-4223-9f5f-fc50e50c807d None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.354288 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299036-be6f-4223-9f5f-fc50e50c807d None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.354562 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299036-be6f-4223-9f5f-fc50e50c807d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.435959 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6299036-be6f-4223-9f5f-fc50e50c807d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:38.437948 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6299036-be6f-4223-9f5f-fc50e50c807d None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:38.438750 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5503505-c67e-4cce-9d4c-ef66225f6c67 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:38.540566 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dc90b-e2e2-44f5-a94c-3156fcb38661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:38.541189 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dc90b-e2e2-44f5-a94c-3156fcb38661 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.541467 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dc90b-e2e2-44f5-a94c-3156fcb38661 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.541739 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dc90b-e2e2-44f5-a94c-3156fcb38661 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.542466 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dc90b-e2e2-44f5-a94c-3156fcb38661 None admin] RBAC: Adding query filter params (group.id=ff4c6a284366462c94d732767704ba67, role.id=57d5f513f8fd4d7dbd1ef0ecc319892e, scope.project.id=f40ec939fdcc422995f7ce0c3973152d) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:38.542774 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dc90b-e2e2-44f5-a94c-3156fcb38661 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:38.544385 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dc90b-e2e2-44f5-a94c-3156fcb38661 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:38.555867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 214/427] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:07:38.557937 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 214/428] 10.222.0.58 () {56 vars in 1376 bytes} [Tue Aug 23 22:07:38 2022] GET /identity/v3/role_assignments?group.id=ff4c6a284366462c94d732767704ba67&scope.project.id=f40ec939fdcc422995f7ce0c3973152d&role.id=57d5f513f8fd4d7dbd1ef0ecc319892e => generated 611 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:38.561740 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299036-be6f-4223-9f5f-fc50e50c807d None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:38.596402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:38.727210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299036-be6f-4223-9f5f-fc50e50c807d None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:38.771204 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddea6f-cec8-4575-b74e-558bee7833a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:38.771918 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddea6f-cec8-4575-b74e-558bee7833a8 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.772205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddea6f-cec8-4575-b74e-558bee7833a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.773130 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddea6f-cec8-4575-b74e-558bee7833a8 None admin] PATH_INFO: `/v3/projects/f40ec939fdcc422995f7ce0c3973152d` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.774405 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddea6f-cec8-4575-b74e-558bee7833a8 None admin] RBAC: Authorizing `identity:get_project(project_id=f40ec939fdcc422995f7ce0c3973152d)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:38.776078 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddea6f-cec8-4575-b74e-558bee7833a8 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:38.777999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 215/429] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:38 2022] GET /identity/v3/projects/f40ec939fdcc422995f7ce0c3973152d => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:38.783459 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dc90b-e2e2-44f5-a94c-3156fcb38661 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:38.879580 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df6b2-dd29-4125-8041-b753f24f0709 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.879908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df6b2-dd29-4125-8041-b753f24f0709 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.880285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df6b2-dd29-4125-8041-b753f24f0709 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.885011 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 216/430] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:38.891460 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd890c-3d10-4cd5-9455-a8273f692c9e None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.892070 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd890c-3d10-4cd5-9455-a8273f692c9e None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.892578 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd890c-3d10-4cd5-9455-a8273f692c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.916999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-e7fd890c-3d10-4cd5-9455-a8273f692c9e None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:38.918564 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-e7fd890c-3d10-4cd5-9455-a8273f692c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:38.936810 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dc90b-e2e2-44f5-a94c-3156fcb38661 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:38.966660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:38.981493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef3511-8836-4899-967d-07742546d521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:38.982136 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3511-8836-4899-967d-07742546d521 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.982418 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3511-8836-4899-967d-07742546d521 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.982703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3511-8836-4899-967d-07742546d521 None admin] PATH_INFO: `/v3/groups/ff4c6a284366462c94d732767704ba67` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.983922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef3511-8836-4899-967d-07742546d521 None admin] RBAC: Authorizing `identity:get_group(group_id=ff4c6a284366462c94d732767704ba67)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:38.985333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef3511-8836-4899-967d-07742546d521 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:38.987224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 215/431] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:38 2022] GET /identity/v3/groups/ff4c6a284366462c94d732767704ba67 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:38.988418 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30657d0-8732-45bd-9af4-09b9449b21a6 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.988722 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30657d0-8732-45bd-9af4-09b9449b21a6 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.988982 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30657d0-8732-45bd-9af4-09b9449b21a6 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:38.990476 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 216/432] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:38.998053 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91da71-faad-49c7-b125-ac8c3d3d47d0 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:38.998582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91da71-faad-49c7-b125-ac8c3d3d47d0 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:38.999165 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91da71-faad-49c7-b125-ac8c3d3d47d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.013686 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 217/433] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:39.014911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd890c-3d10-4cd5-9455-a8273f692c9e None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.021058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-0b91da71-faad-49c7-b125-ac8c3d3d47d0 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:39.022316 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-0b91da71-faad-49c7-b125-ac8c3d3d47d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:39.057142 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:39.103975 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 217/434] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:39.143687 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd890c-3d10-4cd5-9455-a8273f692c9e None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.181084 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95583f79-8973-44df-9c76-4aa9bb94b2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.181742 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583f79-8973-44df-9c76-4aa9bb94b2c5 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.182025 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583f79-8973-44df-9c76-4aa9bb94b2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.182294 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95583f79-8973-44df-9c76-4aa9bb94b2c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.183024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95583f79-8973-44df-9c76-4aa9bb94b2c5 None admin] RBAC: Adding query filter params (group.id=ff4c6a284366462c94d732767704ba67, role.id=035d7eb5fa4e47919e159810a449df68, scope.project.id=f40ec939fdcc422995f7ce0c3973152d) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:39.183330 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95583f79-8973-44df-9c76-4aa9bb94b2c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:39.184798 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95583f79-8973-44df-9c76-4aa9bb94b2c5 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:39.191395 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 218/435] 10.222.0.58 () {56 vars in 1376 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/role_assignments?group.id=ff4c6a284366462c94d732767704ba67&scope.project.id=f40ec939fdcc422995f7ce0c3973152d&role.id=035d7eb5fa4e47919e159810a449df68 => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:39.388755 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91da71-faad-49c7-b125-ac8c3d3d47d0 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.469125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95583f79-8973-44df-9c76-4aa9bb94b2c5 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.508250 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91da71-faad-49c7-b125-ac8c3d3d47d0 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.533558 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:39.558244 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764821-5aea-4c2c-b25e-02ca17d5be1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.558882 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764821-5aea-4c2c-b25e-02ca17d5be1f None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.559165 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764821-5aea-4c2c-b25e-02ca17d5be1f None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.559437 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764821-5aea-4c2c-b25e-02ca17d5be1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.571148 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11764821-5aea-4c2c-b25e-02ca17d5be1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-11764821-5aea-4c2c-b25e-02ca17d5be1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:39.576679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:39.577585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:39.578390 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 218/436] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:39.586233 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764821-5aea-4c2c-b25e-02ca17d5be1f None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.604796 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:39.611271 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95583f79-8973-44df-9c76-4aa9bb94b2c5 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.662686 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e42380-d361-4e85-a4e0-9ad5f74e13c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.663697 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42380-d361-4e85-a4e0-9ad5f74e13c0 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.664254 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42380-d361-4e85-a4e0-9ad5f74e13c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.664629 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e42380-d361-4e85-a4e0-9ad5f74e13c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.675804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e42380-d361-4e85-a4e0-9ad5f74e13c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-b0e42380-d361-4e85-a4e0-9ad5f74e13c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:39.681129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:39.682046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:39.682840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 219/437] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:39.689621 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e42380-d361-4e85-a4e0-9ad5f74e13c0 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.720824 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764821-5aea-4c2c-b25e-02ca17d5be1f None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.774964 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1606b4-6302-489d-a1e9-15864a8bf7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.775694 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1606b4-6302-489d-a1e9-15864a8bf7f2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.776081 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1606b4-6302-489d-a1e9-15864a8bf7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.776358 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1606b4-6302-489d-a1e9-15864a8bf7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.777630 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1606b4-6302-489d-a1e9-15864a8bf7f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:39.777968 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1606b4-6302-489d-a1e9-15864a8bf7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:39.779333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1606b4-6302-489d-a1e9-15864a8bf7f2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:39.794839 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 219/438] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:39.796158 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1606b4-6302-489d-a1e9-15864a8bf7f2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.823340 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e42380-d361-4e85-a4e0-9ad5f74e13c0 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.846847 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:39.860497 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3ea93-03aa-45bd-9d16-a46da0baed0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.861103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3ea93-03aa-45bd-9d16-a46da0baed0c None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.861380 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3ea93-03aa-45bd-9d16-a46da0baed0c None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.861656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c3ea93-03aa-45bd-9d16-a46da0baed0c None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.862319 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3ea93-03aa-45bd-9d16-a46da0baed0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:39.862618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3ea93-03aa-45bd-9d16-a46da0baed0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:39.864013 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c3ea93-03aa-45bd-9d16-a46da0baed0c None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:39.872848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 220/439] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:39.879103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3ea93-03aa-45bd-9d16-a46da0baed0c None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:39.894535 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:39.912086 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1606b4-6302-489d-a1e9-15864a8bf7f2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:39.946145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfe6ba-812b-4adb-aded-89df6b1d04df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:39.946750 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfe6ba-812b-4adb-aded-89df6b1d04df None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:39.947028 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfe6ba-812b-4adb-aded-89df6b1d04df None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:39.947299 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfe6ba-812b-4adb-aded-89df6b1d04df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:39.986259 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c3ea93-03aa-45bd-9d16-a46da0baed0c None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.018298 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfe6ba-812b-4adb-aded-89df6b1d04df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.019760 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfe6ba-812b-4adb-aded-89df6b1d04df None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.026543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c96471-7d43-459d-b332-9e11c73af4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.027318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c96471-7d43-459d-b332-9e11c73af4e5 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.027678 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c96471-7d43-459d-b332-9e11c73af4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.027987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c96471-7d43-459d-b332-9e11c73af4e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.067001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.106497 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c96471-7d43-459d-b332-9e11c73af4e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.108019 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c96471-7d43-459d-b332-9e11c73af4e5 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.122842 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.129077 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 220/440] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:40.129077 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4fa43-0d28-4eb2-82fa-0a1f2da648ea None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.129077 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4fa43-0d28-4eb2-82fa-0a1f2da648ea None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.129077 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4fa43-0d28-4eb2-82fa-0a1f2da648ea None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.129077 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 221/441] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:40.130255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4fa43-0d28-4eb2-82fa-0a1f2da648ea None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.212370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 221/442] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:40.212370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24d7fa-c547-46a9-95a7-bde8d149beb1 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.212370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24d7fa-c547-46a9-95a7-bde8d149beb1 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.212370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24d7fa-c547-46a9-95a7-bde8d149beb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.235143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-9e24d7fa-c547-46a9-95a7-bde8d149beb1 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:40.236443 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-9e24d7fa-c547-46a9-95a7-bde8d149beb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:40.238209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4fa43-0d28-4eb2-82fa-0a1f2da648ea None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.273323 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a533ef3-3375-417d-88ca-3be554d534bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.273946 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533ef3-3375-417d-88ca-3be554d534bb None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.274223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533ef3-3375-417d-88ca-3be554d534bb None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.274496 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a533ef3-3375-417d-88ca-3be554d534bb None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.275604 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a533ef3-3375-417d-88ca-3be554d534bb None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.277094 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a533ef3-3375-417d-88ca-3be554d534bb None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.278701 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 222/443] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:40.279569 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a533ef3-3375-417d-88ca-3be554d534bb None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.294461 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.306044 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 222/444] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:40.306881 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24d7fa-c547-46a9-95a7-bde8d149beb1 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.360199 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.385080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a533ef3-3375-417d-88ca-3be554d534bb None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.419205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24d7fa-c547-46a9-95a7-bde8d149beb1 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.421426 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e3e0f-fdfe-48a1-bb98-a105373f63ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.422051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e3e0f-fdfe-48a1-bb98-a105373f63ba None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.422331 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e3e0f-fdfe-48a1-bb98-a105373f63ba None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.422595 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e3e0f-fdfe-48a1-bb98-a105373f63ba None admin] PATH_INFO: `/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.423738 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e3e0f-fdfe-48a1-bb98-a105373f63ba None admin] RBAC: Authorizing `identity:get_project(project_id=55b0cf9bc7ac44fb9653e814ea675fff)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.425216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e3e0f-fdfe-48a1-bb98-a105373f63ba None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.426986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 223/445] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/projects/55b0cf9bc7ac44fb9653e814ea675fff => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:40.433031 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e3e0f-fdfe-48a1-bb98-a105373f63ba None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.455135 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3af76-26b9-449a-910a-7e8d14b2d088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.455773 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3af76-26b9-449a-910a-7e8d14b2d088 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.456082 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3af76-26b9-449a-910a-7e8d14b2d088 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.456357 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3af76-26b9-449a-910a-7e8d14b2d088 None admin] PATH_INFO: `/v3/groups/ff4c6a284366462c94d732767704ba67` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.457469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3af76-26b9-449a-910a-7e8d14b2d088 None admin] RBAC: Authorizing `identity:get_group(group_id=ff4c6a284366462c94d732767704ba67)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.458906 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3af76-26b9-449a-910a-7e8d14b2d088 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.460709 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 223/446] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/groups/ff4c6a284366462c94d732767704ba67 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:40.466339 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3af76-26b9-449a-910a-7e8d14b2d088 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.529296 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.549545 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e3e0f-fdfe-48a1-bb98-a105373f63ba None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.575133 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3af76-26b9-449a-910a-7e8d14b2d088 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.584097 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80e19b-d6a0-4a98-9c41-6be677fdd0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.584726 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80e19b-d6a0-4a98-9c41-6be677fdd0ab None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.585600 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80e19b-d6a0-4a98-9c41-6be677fdd0ab None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.585871 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80e19b-d6a0-4a98-9c41-6be677fdd0ab None admin] PATH_INFO: `/v3/groups/ff4c6a284366462c94d732767704ba67` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.587003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80e19b-d6a0-4a98-9c41-6be677fdd0ab None admin] RBAC: Authorizing `identity:get_group(group_id=ff4c6a284366462c94d732767704ba67)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.588480 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80e19b-d6a0-4a98-9c41-6be677fdd0ab None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.589242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.590271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 224/447] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/groups/ff4c6a284366462c94d732767704ba67 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:40.596165 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80e19b-d6a0-4a98-9c41-6be677fdd0ab None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.613557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667f4f4-baca-4c36-9aae-7053375d0e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.614161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667f4f4-baca-4c36-9aae-7053375d0e11 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.614444 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667f4f4-baca-4c36-9aae-7053375d0e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.614719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667f4f4-baca-4c36-9aae-7053375d0e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.615448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667f4f4-baca-4c36-9aae-7053375d0e11 None admin] RBAC: Adding query filter params (group.id=ff4c6a284366462c94d732767704ba67, role.id=57d5f513f8fd4d7dbd1ef0ecc319892e, scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:40.615756 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667f4f4-baca-4c36-9aae-7053375d0e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.617870 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667f4f4-baca-4c36-9aae-7053375d0e11 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.623731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 224/448] 10.222.0.58 () {56 vars in 1376 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/role_assignments?group.id=ff4c6a284366462c94d732767704ba67&scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff&role.id=57d5f513f8fd4d7dbd1ef0ecc319892e => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:40.645158 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667f4f4-baca-4c36-9aae-7053375d0e11 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.726856 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80e19b-d6a0-4a98-9c41-6be677fdd0ab None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.763430 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667f4f4-baca-4c36-9aae-7053375d0e11 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:40.775557 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a468e8-4c6a-4abd-bce2-8f40599dbce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.776653 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a468e8-4c6a-4abd-bce2-8f40599dbce4 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.777300 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a468e8-4c6a-4abd-bce2-8f40599dbce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.777628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a468e8-4c6a-4abd-bce2-8f40599dbce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.778354 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a468e8-4c6a-4abd-bce2-8f40599dbce4 None admin] RBAC: Adding query filter params (group.id=ff4c6a284366462c94d732767704ba67, role.id=035d7eb5fa4e47919e159810a449df68, scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:40.778945 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a468e8-4c6a-4abd-bce2-8f40599dbce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:40.781036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a468e8-4c6a-4abd-bce2-8f40599dbce4 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:40.790122 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 225/449] 10.222.0.58 () {56 vars in 1376 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/role_assignments?group.id=ff4c6a284366462c94d732767704ba67&scope.project.id=55b0cf9bc7ac44fb9653e814ea675fff&role.id=035d7eb5fa4e47919e159810a449df68 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:40.811718 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177dbfa-cae9-4399-9938-172212674324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:40.812414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177dbfa-cae9-4399-9938-172212674324 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:40.812701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177dbfa-cae9-4399-9938-172212674324 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:40.812971 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177dbfa-cae9-4399-9938-172212674324 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:40.827459 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177dbfa-cae9-4399-9938-172212674324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-9177dbfa-cae9-4399-9938-172212674324 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:40.835689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:40.836886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:40.837685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 225/450] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:40.843027 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a468e8-4c6a-4abd-bce2-8f40599dbce4 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:40.862892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:40.972001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a468e8-4c6a-4abd-bce2-8f40599dbce4 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:41.010657 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9448b-8236-413d-bdc1-18912e989e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:41.011272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9448b-8236-413d-bdc1-18912e989e47 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:41.011537 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9448b-8236-413d-bdc1-18912e989e47 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:41.011803 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9448b-8236-413d-bdc1-18912e989e47 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:41.012495 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9448b-8236-413d-bdc1-18912e989e47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:41.012801 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9448b-8236-413d-bdc1-18912e989e47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:41.014250 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9448b-8236-413d-bdc1-18912e989e47 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:41.023563 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 226/451] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:41.029180 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177dbfa-cae9-4399-9938-172212674324 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:41.072181 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:41.148081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177dbfa-cae9-4399-9938-172212674324 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:41.183439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb63d48-adb4-49bf-a42d-ce514d63c1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:41.184067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb63d48-adb4-49bf-a42d-ce514d63c1c7 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:41.184349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb63d48-adb4-49bf-a42d-ce514d63c1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:41.184620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb63d48-adb4-49bf-a42d-ce514d63c1c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:41.255166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb63d48-adb4-49bf-a42d-ce514d63c1c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:41.256739 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb63d48-adb4-49bf-a42d-ce514d63c1c7 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:41.290582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:41.356598 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 226/452] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:41.362166 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9448b-8236-413d-bdc1-18912e989e47 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:41.435540 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:41.459938 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9448b-8236-413d-bdc1-18912e989e47 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:41.492630 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76056444-4dd5-4cba-8f67-a33568537880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:41.493229 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76056444-4dd5-4cba-8f67-a33568537880 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:41.493509 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76056444-4dd5-4cba-8f67-a33568537880 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:41.493782 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76056444-4dd5-4cba-8f67-a33568537880 None admin] PATH_INFO: `/v3/projects/8dbd689839d74dba96df18fba25139c2` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:41.494889 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76056444-4dd5-4cba-8f67-a33568537880 None admin] RBAC: Authorizing `identity:get_project(project_id=8dbd689839d74dba96df18fba25139c2)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:41.496379 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76056444-4dd5-4cba-8f67-a33568537880 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:41.497998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 227/453] 10.222.0.58 () {56 vars in 1186 bytes} [Tue Aug 23 22:07:41 2022] GET /identity/v3/projects/8dbd689839d74dba96df18fba25139c2 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:41.503416 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb63d48-adb4-49bf-a42d-ce514d63c1c7 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:41.615246 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb63d48-adb4-49bf-a42d-ce514d63c1c7 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:41.651588 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd469af-2779-4d3e-8eb2-e914a3ab0cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:41.652242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd469af-2779-4d3e-8eb2-e914a3ab0cd6 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:41.652527 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd469af-2779-4d3e-8eb2-e914a3ab0cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:41.652810 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd469af-2779-4d3e-8eb2-e914a3ab0cd6 None admin] PATH_INFO: `/v3/groups/660d12ea28424e869dfeef023e639fe7` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:41.653926 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd469af-2779-4d3e-8eb2-e914a3ab0cd6 None admin] RBAC: Authorizing `identity:get_group(group_id=660d12ea28424e869dfeef023e639fe7)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:41.655366 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd469af-2779-4d3e-8eb2-e914a3ab0cd6 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:41.657000 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 227/454] 10.222.0.58 () {56 vars in 1180 bytes} [Tue Aug 23 22:07:41 2022] GET /identity/v3/groups/660d12ea28424e869dfeef023e639fe7 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:41.663662 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76056444-4dd5-4cba-8f67-a33568537880 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:41.766128 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76056444-4dd5-4cba-8f67-a33568537880 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:41.799317 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de2ddc-84b3-4881-bd9c-cdaeb98de7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:41.799957 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de2ddc-84b3-4881-bd9c-cdaeb98de7ab None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:41.800244 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de2ddc-84b3-4881-bd9c-cdaeb98de7ab None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:41.800522 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de2ddc-84b3-4881-bd9c-cdaeb98de7ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:41.801283 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de2ddc-84b3-4881-bd9c-cdaeb98de7ab None admin] RBAC: Adding query filter params (group.id=660d12ea28424e869dfeef023e639fe7, role.id=81a7cb1c95fd45708dbee5e4dc91626b, scope.project.id=8dbd689839d74dba96df18fba25139c2) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:41.801592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de2ddc-84b3-4881-bd9c-cdaeb98de7ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:41.803029 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de2ddc-84b3-4881-bd9c-cdaeb98de7ab None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:41.809419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 228/455] 10.222.0.58 () {56 vars in 1376 bytes} [Tue Aug 23 22:07:41 2022] GET /identity/v3/role_assignments?group.id=660d12ea28424e869dfeef023e639fe7&scope.project.id=8dbd689839d74dba96df18fba25139c2&role.id=81a7cb1c95fd45708dbee5e4dc91626b => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:44.342396 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b020-621b-43f9-8e65-06a9241e53fb None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.342927 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b020-621b-43f9-8e65-06a9241e53fb None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.342927 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69b020-621b-43f9-8e65-06a9241e53fb None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.344918 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 228/456] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:44.351568 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bfd02-58a2-4b0f-9ab2-4fff7c8fb5e2 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.352136 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bfd02-58a2-4b0f-9ab2-4fff7c8fb5e2 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.352136 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5bfd02-58a2-4b0f-9ab2-4fff7c8fb5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.366375 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:44.372226 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-6d5bfd02-58a2-4b0f-9ab2-4fff7c8fb5e2 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:44.373902 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-6d5bfd02-58a2-4b0f-9ab2-4fff7c8fb5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:44.446176 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 229/457] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:44.515408 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4c97a-79d1-45ad-ba15-c3a12ed9edb2 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.515740 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4c97a-79d1-45ad-ba15-c3a12ed9edb2 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.516055 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4c97a-79d1-45ad-ba15-c3a12ed9edb2 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.517492 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 229/458] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:44.525305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0ff9a-84b7-495d-8323-0db6e272fdd5 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.525806 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0ff9a-84b7-495d-8323-0db6e272fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.526312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0ff9a-84b7-495d-8323-0db6e272fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.549882 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-93f0ff9a-84b7-495d-8323-0db6e272fdd5 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:44.551100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-93f0ff9a-84b7-495d-8323-0db6e272fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:44.627221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 230/459] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:44.691401 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d0e2d-2853-4f32-821d-fb75f91354ba None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.691738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d0e2d-2853-4f32-821d-fb75f91354ba None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.691968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d0e2d-2853-4f32-821d-fb75f91354ba None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.693510 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 230/460] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:44.699599 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114b08b-4e14-4157-a8d4-b9bd79cd8df7 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.699910 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114b08b-4e14-4157-a8d4-b9bd79cd8df7 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.700192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114b08b-4e14-4157-a8d4-b9bd79cd8df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.722459 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-6114b08b-4e14-4157-a8d4-b9bd79cd8df7 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:44.723652 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-6114b08b-4e14-4157-a8d4-b9bd79cd8df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:44.786813 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:44.793041 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d0e2d-2853-4f32-821d-fb75f91354ba None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:44.795395 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 231/461] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:44.799888 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:44.916716 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d0e2d-2853-4f32-821d-fb75f91354ba None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:44.953329 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150d498-1b42-4d50-8c9f-68996d0a49b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:44.953961 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d498-1b42-4d50-8c9f-68996d0a49b5 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:44.954247 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d498-1b42-4d50-8c9f-68996d0a49b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:44.954520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d498-1b42-4d50-8c9f-68996d0a49b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:44.965955 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150d498-1b42-4d50-8c9f-68996d0a49b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:44.967414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150d498-1b42-4d50-8c9f-68996d0a49b5 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:44.980071 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114b08b-4e14-4157-a8d4-b9bd79cd8df7 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-0150d498-1b42-4d50-8c9f-68996d0a49b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:44.982809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:44.983719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:44.984639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:44.984639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:44.984639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:44.984639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 231/462] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:44.989898 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150d498-1b42-4d50-8c9f-68996d0a49b5 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.059677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:45.100454 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114b08b-4e14-4157-a8d4-b9bd79cd8df7 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.108487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150d498-1b42-4d50-8c9f-68996d0a49b5 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.138966 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cbd65-f6d9-4248-9270-a3617ad0f63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.139948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cbd65-f6d9-4248-9270-a3617ad0f63d None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.140235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cbd65-f6d9-4248-9270-a3617ad0f63d None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.140510 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cbd65-f6d9-4248-9270-a3617ad0f63d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.144264 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebd6f9-98bb-4ea8-bcb6-b4fef85f10bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.144868 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebd6f9-98bb-4ea8-bcb6-b4fef85f10bc None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.145155 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebd6f9-98bb-4ea8-bcb6-b4fef85f10bc None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.145423 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebd6f9-98bb-4ea8-bcb6-b4fef85f10bc None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.146062 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebd6f9-98bb-4ea8-bcb6-b4fef85f10bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:45.146362 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebd6f9-98bb-4ea8-bcb6-b4fef85f10bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.148524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebd6f9-98bb-4ea8-bcb6-b4fef85f10bc None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.151429 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cbd65-f6d9-4248-9270-a3617ad0f63d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.152946 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cbd65-f6d9-4248-9270-a3617ad0f63d None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.160356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 232/463] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:45.161602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8e985-3738-4bf6-9704-5a9beb2b6081 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.161888 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8e985-3738-4bf6-9704-5a9beb2b6081 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.162179 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8e985-3738-4bf6-9704-5a9beb2b6081 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.164026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 233/464] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:45.164717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8e985-3738-4bf6-9704-5a9beb2b6081 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-978cbd65-f6d9-4248-9270-a3617ad0f63d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:45.172412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:45.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:45.174199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:45.174199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:45.174199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:45.174199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 232/465] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:45.175690 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cbd65-f6d9-4248-9270-a3617ad0f63d None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.227505 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:45.274093 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8e985-3738-4bf6-9704-5a9beb2b6081 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.284065 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cbd65-f6d9-4248-9270-a3617ad0f63d None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.294423 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:45.312441 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fb7f6-c34b-4365-8a66-bf1f821bad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.313001 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fb7f6-c34b-4365-8a66-bf1f821bad8b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.313284 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fb7f6-c34b-4365-8a66-bf1f821bad8b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.313557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fb7f6-c34b-4365-8a66-bf1f821bad8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.318378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e5e68-44aa-47d9-a442-389e10592207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.319080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e5e68-44aa-47d9-a442-389e10592207 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.319531 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e5e68-44aa-47d9-a442-389e10592207 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.320010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e5e68-44aa-47d9-a442-389e10592207 None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.320644 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e5e68-44aa-47d9-a442-389e10592207 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.322073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e5e68-44aa-47d9-a442-389e10592207 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.323530 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fb7f6-c34b-4365-8a66-bf1f821bad8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.325013 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fb7f6-c34b-4365-8a66-bf1f821bad8b None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-165fb7f6-c34b-4365-8a66-bf1f821bad8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:45.340699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:45.341714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:45.353433 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:45.353433 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:45.353433 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:45.353433 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 234/466] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:45.353694 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 233/467] 10.222.0.58 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:45 2022] POST /identity/v3/users => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:45.353694 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e5e68-44aa-47d9-a442-389e10592207 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.354110 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a742d-dc17-4556-ba22-60efd8b948fc None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.354110 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a742d-dc17-4556-ba22-60efd8b948fc None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.354110 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a742d-dc17-4556-ba22-60efd8b948fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.366774 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-1e6a742d-dc17-4556-ba22-60efd8b948fc None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:45.368277 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-1e6a742d-dc17-4556-ba22-60efd8b948fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:45.445990 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 235/468] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:45.447308 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a742d-dc17-4556-ba22-60efd8b948fc None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.487034 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e5e68-44aa-47d9-a442-389e10592207 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.497752 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:45.540080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e540d6-69b5-4440-8840-009c29aeda9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.541158 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e540d6-69b5-4440-8840-009c29aeda9e None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.541651 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e540d6-69b5-4440-8840-009c29aeda9e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.542523 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e540d6-69b5-4440-8840-009c29aeda9e None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.543407 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e540d6-69b5-4440-8840-009c29aeda9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:45.543808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e540d6-69b5-4440-8840-009c29aeda9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.545222 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e540d6-69b5-4440-8840-009c29aeda9e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.559166 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 234/469] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:45.565068 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e540d6-69b5-4440-8840-009c29aeda9e None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.566564 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:45.572821 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a742d-dc17-4556-ba22-60efd8b948fc None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.623180 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f986d-40ad-4e97-abea-614355176fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.624293 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f986d-40ad-4e97-abea-614355176fc5 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.624605 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f986d-40ad-4e97-abea-614355176fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.624882 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3f986d-40ad-4e97-abea-614355176fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.625532 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f986d-40ad-4e97-abea-614355176fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:45.626203 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f986d-40ad-4e97-abea-614355176fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.627986 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3f986d-40ad-4e97-abea-614355176fc5 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.646391 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 236/470] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:45.652885 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f986d-40ad-4e97-abea-614355176fc5 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.703379 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e540d6-69b5-4440-8840-009c29aeda9e None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.752613 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758cd84-a3e4-4a12-83c4-b599564bec70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.753817 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758cd84-a3e4-4a12-83c4-b599564bec70 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.754116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758cd84-a3e4-4a12-83c4-b599564bec70 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.754391 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758cd84-a3e4-4a12-83c4-b599564bec70 None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.755176 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758cd84-a3e4-4a12-83c4-b599564bec70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.757835 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758cd84-a3e4-4a12-83c4-b599564bec70 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.767627 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3f986d-40ad-4e97-abea-614355176fc5 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.792136 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 235/471] 10.222.0.58 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:45 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:07:45.796725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758cd84-a3e4-4a12-83c4-b599564bec70 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:45.822383 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a5f61-cb9c-4881-a8b9-b74ff3d1ad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.822923 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a5f61-cb9c-4881-a8b9-b74ff3d1ad56 None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.823204 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a5f61-cb9c-4881-a8b9-b74ff3d1ad56 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.823525 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a5f61-cb9c-4881-a8b9-b74ff3d1ad56 None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.824210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a5f61-cb9c-4881-a8b9-b74ff3d1ad56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.825604 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:45.827211 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a5f61-cb9c-4881-a8b9-b74ff3d1ad56 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:45.861182 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 237/472] 10.222.0.58 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:45 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:07:45.927707 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758cd84-a3e4-4a12-83c4-b599564bec70 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:45.972795 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24503b14-0476-4804-86eb-acb9c2d40190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:45.973596 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503b14-0476-4804-86eb-acb9c2d40190 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:45.973884 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503b14-0476-4804-86eb-acb9c2d40190 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:45.974200 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503b14-0476-4804-86eb-acb9c2d40190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:45.988165 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24503b14-0476-4804-86eb-acb9c2d40190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:45.989672 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24503b14-0476-4804-86eb-acb9c2d40190 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-24503b14-0476-4804-86eb-acb9c2d40190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:46.008100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:46.009221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:46.010058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:46.010058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:46.010058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:46.010058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 236/473] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:46.015825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a5f61-cb9c-4881-a8b9-b74ff3d1ad56 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:46.037099 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:46.136397 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a5f61-cb9c-4881-a8b9-b74ff3d1ad56 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:46.174542 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e4a4b-dc7c-4bd1-9a46-1d91a76de504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:46.175151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e4a4b-dc7c-4bd1-9a46-1d91a76de504 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:46.175431 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e4a4b-dc7c-4bd1-9a46-1d91a76de504 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:46.175703 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e4a4b-dc7c-4bd1-9a46-1d91a76de504 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:46.176374 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e4a4b-dc7c-4bd1-9a46-1d91a76de504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:46.176675 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e4a4b-dc7c-4bd1-9a46-1d91a76de504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:46.178101 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e4a4b-dc7c-4bd1-9a46-1d91a76de504 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:46.191301 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 238/474] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:46.197690 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24503b14-0476-4804-86eb-acb9c2d40190 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:46.275332 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:46.307729 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24503b14-0476-4804-86eb-acb9c2d40190 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:46.344453 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ad9ab-a665-4da9-a532-81e3383cb8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:46.345067 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ad9ab-a665-4da9-a532-81e3383cb8af None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:46.345348 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ad9ab-a665-4da9-a532-81e3383cb8af None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:46.345622 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ad9ab-a665-4da9-a532-81e3383cb8af None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:46.346280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ad9ab-a665-4da9-a532-81e3383cb8af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:46.347710 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ad9ab-a665-4da9-a532-81e3383cb8af None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:46.374385 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 237/475] 10.222.0.58 () {60 vars in 1132 bytes} [Tue Aug 23 22:07:46 2022] POST /identity/v3/users => generated 249 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:07:47.695581 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c307b73-4c80-4d49-8026-fa8777bed92e None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:47.696127 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c307b73-4c80-4d49-8026-fa8777bed92e None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:47.696412 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c307b73-4c80-4d49-8026-fa8777bed92e None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:47.697874 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 239/476] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:47.703425 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3734cd-28be-4714-bc65-5693d293e140 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:47.704262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3734cd-28be-4714-bc65-5693d293e140 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:47.704730 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3734cd-28be-4714-bc65-5693d293e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:47.724789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-0e3734cd-28be-4714-bc65-5693d293e140 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:47.726641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-0e3734cd-28be-4714-bc65-5693d293e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:47.803810 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 238/477] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:48.142908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c307b73-4c80-4d49-8026-fa8777bed92e None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:48.225084 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68a99e-12a3-4a9e-93d0-6a80868a1556 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.225429 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68a99e-12a3-4a9e-93d0-6a80868a1556 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.225866 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68a99e-12a3-4a9e-93d0-6a80868a1556 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.226759 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:48.227714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 239/478] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:48.239043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60431c3a-8681-422e-bca3-60be664e1f45 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.239541 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60431c3a-8681-422e-bca3-60be664e1f45 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.240048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60431c3a-8681-422e-bca3-60be664e1f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.257032 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c307b73-4c80-4d49-8026-fa8777bed92e None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:48.261298 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-60431c3a-8681-422e-bca3-60be664e1f45 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:48.262511 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-60431c3a-8681-422e-bca3-60be664e1f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:48.297823 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c1899-886e-41ee-9c5f-3d692a66db46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:48.298448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c1899-886e-41ee-9c5f-3d692a66db46 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.298730 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c1899-886e-41ee-9c5f-3d692a66db46 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.299005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c1899-886e-41ee-9c5f-3d692a66db46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.312060 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c1899-886e-41ee-9c5f-3d692a66db46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-b58c1899-886e-41ee-9c5f-3d692a66db46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:48.317109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:48.317996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:48.318864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 240/479] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:07:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:48.320402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb0e6-e5f7-4dcd-8809-955dbd124d98 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.320402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb0e6-e5f7-4dcd-8809-955dbd124d98 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.320402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb0e6-e5f7-4dcd-8809-955dbd124d98 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.323875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 241/480] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:48.323875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccb0e6-e5f7-4dcd-8809-955dbd124d98 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:48.328521 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:48.351474 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 240/481] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:48.351474 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e6f07-590a-46d7-ac8b-28d88d232d01 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.351474 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e6f07-590a-46d7-ac8b-28d88d232d01 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.351474 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e6f07-590a-46d7-ac8b-28d88d232d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.366592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-102e6f07-590a-46d7-ac8b-28d88d232d01 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:48.367816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-102e6f07-590a-46d7-ac8b-28d88d232d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:48.439324 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 241/482] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:48.458204 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccb0e6-e5f7-4dcd-8809-955dbd124d98 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:48.496505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54dbe5-eed9-4fe2-9753-3dd5451fc057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:48.497460 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54dbe5-eed9-4fe2-9753-3dd5451fc057 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.498000 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54dbe5-eed9-4fe2-9753-3dd5451fc057 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.498462 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54dbe5-eed9-4fe2-9753-3dd5451fc057 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.499301 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54dbe5-eed9-4fe2-9753-3dd5451fc057 None admin] RBAC: Adding query filter params (name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:48.499791 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54dbe5-eed9-4fe2-9753-3dd5451fc057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:48.501440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54dbe5-eed9-4fe2-9753-3dd5451fc057 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:48.502938 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:48.511214 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 242/483] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:07:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:48.516736 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e6f07-590a-46d7-ac8b-28d88d232d01 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:48.633644 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e6f07-590a-46d7-ac8b-28d88d232d01 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:48.651713 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:48.669279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd8313-1642-4a0f-95fa-17be7ce1ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:48.670346 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd8313-1642-4a0f-95fa-17be7ce1ff97 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.670818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd8313-1642-4a0f-95fa-17be7ce1ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.671306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd8313-1642-4a0f-95fa-17be7ce1ff97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.682535 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd8313-1642-4a0f-95fa-17be7ce1ff97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:48.684291 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd8313-1642-4a0f-95fa-17be7ce1ff97 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:48.692287 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54dbe5-eed9-4fe2-9753-3dd5451fc057 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-6fcd8313-1642-4a0f-95fa-17be7ce1ff97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:48.700745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:48.701891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:48.702704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:48.702704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:48.702704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:48.704861 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 242/484] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:48.707080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9024cc-7cae-4912-b15d-13b096c05588 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.707822 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9024cc-7cae-4912-b15d-13b096c05588 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.708259 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9024cc-7cae-4912-b15d-13b096c05588 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.710214 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 243/485] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:48.711505 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9024cc-7cae-4912-b15d-13b096c05588 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:48.808426 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54dbe5-eed9-4fe2-9753-3dd5451fc057 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:48.826357 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9024cc-7cae-4912-b15d-13b096c05588 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:48.842865 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734dac46-5c99-43d4-a9c0-8ac685a476a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:48.843490 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dac46-5c99-43d4-a9c0-8ac685a476a0 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.843775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dac46-5c99-43d4-a9c0-8ac685a476a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.844087 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734dac46-5c99-43d4-a9c0-8ac685a476a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.855698 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734dac46-5c99-43d4-a9c0-8ac685a476a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:48.860621 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375ed1e-4dcc-46b2-b09a-7795812b38af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-734dac46-5c99-43d4-a9c0-8ac685a476a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:48.860801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:48.861797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:48.862595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:48.862595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:48.862595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:48.862595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:48.862595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:48.862595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:48.862595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:48.862595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:48.862595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:48.862595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:48.862595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:48.862595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:48.863215 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ed1e-4dcc-46b2-b09a-7795812b38af None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.863215 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ed1e-4dcc-46b2-b09a-7795812b38af None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.863215 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375ed1e-4dcc-46b2-b09a-7795812b38af None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.863389 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 243/486] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:07:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:07:48.863461 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375ed1e-4dcc-46b2-b09a-7795812b38af None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:48.863461 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375ed1e-4dcc-46b2-b09a-7795812b38af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:48.864216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375ed1e-4dcc-46b2-b09a-7795812b38af None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:48.868346 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54415cd-7f1e-47ea-8b82-d513d6cedb24 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:48.868638 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54415cd-7f1e-47ea-8b82-d513d6cedb24 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:48.868919 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54415cd-7f1e-47ea-8b82-d513d6cedb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:48.875522 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 244/487] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:48.876364 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375ed1e-4dcc-46b2-b09a-7795812b38af None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:48.887731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-f54415cd-7f1e-47ea-8b82-d513d6cedb24 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:48.888976 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-f54415cd-7f1e-47ea-8b82-d513d6cedb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:48.910290 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:48.941452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:48.957930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 244/488] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:48.958683 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54415cd-7f1e-47ea-8b82-d513d6cedb24 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:48.981530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375ed1e-4dcc-46b2-b09a-7795812b38af None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.016508 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc2564-526b-467c-85a3-fe16c42b1ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.017498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc2564-526b-467c-85a3-fe16c42b1ca2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.017976 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc2564-526b-467c-85a3-fe16c42b1ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.018445 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc2564-526b-467c-85a3-fe16c42b1ca2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.029768 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc2564-526b-467c-85a3-fe16c42b1ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-79fc2564-526b-467c-85a3-fe16c42b1ca2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:49.036103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:49.036986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:49.038333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:49.038333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:49.038333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:49.038333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:49.038333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:49.038333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:49.038333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:49.038333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:49.038333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:49.038333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:49.038333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:49.038333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:49.044805 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 245/489] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:07:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:49.045556 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc2564-526b-467c-85a3-fe16c42b1ca2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.065433 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54415cd-7f1e-47ea-8b82-d513d6cedb24 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.103273 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16024b-3e7c-4911-ada8-927ba3112271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.103908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16024b-3e7c-4911-ada8-927ba3112271 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.104198 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16024b-3e7c-4911-ada8-927ba3112271 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.104475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16024b-3e7c-4911-ada8-927ba3112271 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.105140 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16024b-3e7c-4911-ada8-927ba3112271 None admin] RBAC: Adding query filter params (name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:49.105448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16024b-3e7c-4911-ada8-927ba3112271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.106845 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16024b-3e7c-4911-ada8-927ba3112271 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.114987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 245/490] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:07:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:49.116652 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16024b-3e7c-4911-ada8-927ba3112271 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.156352 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.167766 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc2564-526b-467c-85a3-fe16c42b1ca2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.169349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.207414 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb16531-56dd-450d-937a-4267ab9091e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.208358 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16531-56dd-450d-937a-4267ab9091e1 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.208784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16531-56dd-450d-937a-4267ab9091e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.209199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16531-56dd-450d-937a-4267ab9091e1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.217559 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb16531-56dd-450d-937a-4267ab9091e1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.219064 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb16531-56dd-450d-937a-4267ab9091e1 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.228723 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16024b-3e7c-4911-ada8-927ba3112271 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-5bb16531-56dd-450d-937a-4267ab9091e1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:07:49.232797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:49.233682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:49.234574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:49.234574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:49.234574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:07:49.234574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:07:49.234574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:07:49.234574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:07:49.234574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:07:49.234574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:07:49.234574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:07:49.234574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:49.234574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 246/491] 10.222.0.58 () {56 vars in 1093 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:49.235153 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb16531-56dd-450d-937a-4267ab9091e1 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.273061 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efbacb-e0c0-4bcc-9fba-a721b5bb08de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.273666 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efbacb-e0c0-4bcc-9fba-a721b5bb08de None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.273951 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efbacb-e0c0-4bcc-9fba-a721b5bb08de None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.274395 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efbacb-e0c0-4bcc-9fba-a721b5bb08de None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.275854 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efbacb-e0c0-4bcc-9fba-a721b5bb08de None admin] RBAC: Adding query filter params (name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:49.276188 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efbacb-e0c0-4bcc-9fba-a721b5bb08de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.277573 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efbacb-e0c0-4bcc-9fba-a721b5bb08de None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.286411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 246/492] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:49.287213 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efbacb-e0c0-4bcc-9fba-a721b5bb08de None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.344667 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb16531-56dd-450d-937a-4267ab9091e1 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.378580 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7b20e-b925-4ab6-883a-da3273fa9ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.379216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7b20e-b925-4ab6-883a-da3273fa9ce2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.379503 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7b20e-b925-4ab6-883a-da3273fa9ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.379781 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7b20e-b925-4ab6-883a-da3273fa9ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.389373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efbacb-e0c0-4bcc-9fba-a721b5bb08de None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.390716 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7b20e-b925-4ab6-883a-da3273fa9ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.392208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7b20e-b925-4ab6-883a-da3273fa9ce2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.400087 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-d9c7b20e-b925-4ab6-883a-da3273fa9ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:49.407001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:49.407954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:49.408796 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:49.408796 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:49.408796 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:49.408796 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 247/493] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:49.409094 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7b20e-b925-4ab6-883a-da3273fa9ce2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.415425 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.424370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437bcb8-b5e2-4cc9-8715-ab7aa11ee653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.425376 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437bcb8-b5e2-4cc9-8715-ab7aa11ee653 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.425856 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437bcb8-b5e2-4cc9-8715-ab7aa11ee653 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.426357 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437bcb8-b5e2-4cc9-8715-ab7aa11ee653 None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.427628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437bcb8-b5e2-4cc9-8715-ab7aa11ee653 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:49.428170 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437bcb8-b5e2-4cc9-8715-ab7aa11ee653 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.431117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437bcb8-b5e2-4cc9-8715-ab7aa11ee653 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.469127 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 247/494] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:49.470051 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437bcb8-b5e2-4cc9-8715-ab7aa11ee653 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.515788 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7b20e-b925-4ab6-883a-da3273fa9ce2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.549743 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504179e0-de22-4135-8b66-13cbdba1780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.550365 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504179e0-de22-4135-8b66-13cbdba1780a None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.550656 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504179e0-de22-4135-8b66-13cbdba1780a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.550930 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504179e0-de22-4135-8b66-13cbdba1780a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.561636 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504179e0-de22-4135-8b66-13cbdba1780a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:49.565969 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437bcb8-b5e2-4cc9-8715-ab7aa11ee653 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-504179e0-de22-4135-8b66-13cbdba1780a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:49.566731 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:49.567685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 248/495] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:49.569776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504179e0-de22-4135-8b66-13cbdba1780a None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.604835 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aec58-aef3-4608-b22d-57178a5e5511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.605464 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aec58-aef3-4608-b22d-57178a5e5511 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.605747 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aec58-aef3-4608-b22d-57178a5e5511 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.606022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aec58-aef3-4608-b22d-57178a5e5511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.616675 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aec58-aef3-4608-b22d-57178a5e5511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.618153 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aec58-aef3-4608-b22d-57178a5e5511 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.630135 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-3c3aec58-aef3-4608-b22d-57178a5e5511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:49.634344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:49.635230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:49.636082 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:49.636082 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:49.636082 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:49.636082 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 248/496] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:49.636307 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aec58-aef3-4608-b22d-57178a5e5511 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.658185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.675020 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504179e0-de22-4135-8b66-13cbdba1780a None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.707778 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79254daf-3f40-42c8-b9d4-c25da62a31dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.708443 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79254daf-3f40-42c8-b9d4-c25da62a31dc None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.708657 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79254daf-3f40-42c8-b9d4-c25da62a31dc None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.708930 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79254daf-3f40-42c8-b9d4-c25da62a31dc None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.710206 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79254daf-3f40-42c8-b9d4-c25da62a31dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:49.710508 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79254daf-3f40-42c8-b9d4-c25da62a31dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.711914 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79254daf-3f40-42c8-b9d4-c25da62a31dc None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.725658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 249/497] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:49.726267 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79254daf-3f40-42c8-b9d4-c25da62a31dc None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.737617 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aec58-aef3-4608-b22d-57178a5e5511 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.770462 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099f2a6-ce89-4f0f-98af-eb4a7374007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.771063 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099f2a6-ce89-4f0f-98af-eb4a7374007d None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.771348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099f2a6-ce89-4f0f-98af-eb4a7374007d None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.771617 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099f2a6-ce89-4f0f-98af-eb4a7374007d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.827174 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79254daf-3f40-42c8-b9d4-c25da62a31dc None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:49.839238 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099f2a6-ce89-4f0f-98af-eb4a7374007d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.840721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099f2a6-ce89-4f0f-98af-eb4a7374007d None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.850588 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.862478 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbeb9a-b5f8-4faf-bb2a-10e724592996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:49.863221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbeb9a-b5f8-4faf-bb2a-10e724592996 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:49.863331 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:49.863409 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbeb9a-b5f8-4faf-bb2a-10e724592996 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:49.863669 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbeb9a-b5f8-4faf-bb2a-10e724592996 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:49.864481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbeb9a-b5f8-4faf-bb2a-10e724592996 None admin] RBAC: Adding query filter params (name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:49.864824 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbeb9a-b5f8-4faf-bb2a-10e724592996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:49.866753 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbeb9a-b5f8-4faf-bb2a-10e724592996 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:49.874877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 250/498] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:49.875682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbeb9a-b5f8-4faf-bb2a-10e724592996 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.950205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 249/499] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:49.951275 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099f2a6-ce89-4f0f-98af-eb4a7374007d None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:49.977956 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbeb9a-b5f8-4faf-bb2a-10e724592996 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.010844 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1edb93-d4eb-41fc-b4da-fd41518cf7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.011454 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1edb93-d4eb-41fc-b4da-fd41518cf7c2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.011730 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1edb93-d4eb-41fc-b4da-fd41518cf7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.012032 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1edb93-d4eb-41fc-b4da-fd41518cf7c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.012662 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1edb93-d4eb-41fc-b4da-fd41518cf7c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:50.012962 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1edb93-d4eb-41fc-b4da-fd41518cf7c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.014320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1edb93-d4eb-41fc-b4da-fd41518cf7c2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.025719 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 251/500] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:50.026493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1edb93-d4eb-41fc-b4da-fd41518cf7c2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.055380 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099f2a6-ce89-4f0f-98af-eb4a7374007d None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.076530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.081174 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.096519 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22448b12-7aa4-4c99-a080-3cc9fa4a3799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.097136 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22448b12-7aa4-4c99-a080-3cc9fa4a3799 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.097415 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22448b12-7aa4-4c99-a080-3cc9fa4a3799 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.097680 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22448b12-7aa4-4c99-a080-3cc9fa4a3799 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.105077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22448b12-7aa4-4c99-a080-3cc9fa4a3799 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.106540 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22448b12-7aa4-4c99-a080-3cc9fa4a3799 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-22448b12-7aa4-4c99-a080-3cc9fa4a3799 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:07:50.119688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:50.120701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:50.121933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:50.121933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:50.121933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:07:50.121933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:07:50.121933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:07:50.121933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:07:50.121933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:07:50.121933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:07:50.121933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:07:50.121933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:50.121933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 250/501] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:50.121933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22448b12-7aa4-4c99-a080-3cc9fa4a3799 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.138262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1edb93-d4eb-41fc-b4da-fd41518cf7c2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.175896 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381a6e1-fa20-4f54-b935-06dcbe4a2ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.176607 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381a6e1-fa20-4f54-b935-06dcbe4a2ac0 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.176896 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381a6e1-fa20-4f54-b935-06dcbe4a2ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.177170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381a6e1-fa20-4f54-b935-06dcbe4a2ac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.187649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381a6e1-fa20-4f54-b935-06dcbe4a2ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.189229 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381a6e1-fa20-4f54-b935-06dcbe4a2ac0 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-f381a6e1-fa20-4f54-b935-06dcbe4a2ac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:50.204627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:50.205825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:50.206852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:50.206852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:50.206852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:50.206852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 252/502] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:50.206852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381a6e1-fa20-4f54-b935-06dcbe4a2ac0 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.230378 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22448b12-7aa4-4c99-a080-3cc9fa4a3799 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.265053 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff659d7-96a9-4de4-9c6a-01bc14a8e8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.265735 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff659d7-96a9-4de4-9c6a-01bc14a8e8fe None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.266013 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff659d7-96a9-4de4-9c6a-01bc14a8e8fe None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.266281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff659d7-96a9-4de4-9c6a-01bc14a8e8fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.276681 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff659d7-96a9-4de4-9c6a-01bc14a8e8fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.278131 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff659d7-96a9-4de4-9c6a-01bc14a8e8fe None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-bff659d7-96a9-4de4-9c6a-01bc14a8e8fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:50.292257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:50.293209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:50.294048 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:50.294048 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:50.294048 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:50.294048 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 251/503] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:50.294269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff659d7-96a9-4de4-9c6a-01bc14a8e8fe None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.305177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.311192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381a6e1-fa20-4f54-b935-06dcbe4a2ac0 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.326493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.345385 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306c171-6057-48b3-92a8-1c98fb7885e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.346005 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306c171-6057-48b3-92a8-1c98fb7885e2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.346286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306c171-6057-48b3-92a8-1c98fb7885e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.346558 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306c171-6057-48b3-92a8-1c98fb7885e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.354116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306c171-6057-48b3-92a8-1c98fb7885e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.355661 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306c171-6057-48b3-92a8-1c98fb7885e2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-4306c171-6057-48b3-92a8-1c98fb7885e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:07:50.368949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:50.369925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:50.370800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:50.370800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:50.370800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:07:50.370800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:07:50.370800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:07:50.370800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:07:50.370800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:07:50.370800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:07:50.370800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:07:50.370800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:50.370800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 253/504] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:50.370800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306c171-6057-48b3-92a8-1c98fb7885e2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.398720 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff659d7-96a9-4de4-9c6a-01bc14a8e8fe None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.432712 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09ff46-981a-419f-8464-617d18e354d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.433308 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09ff46-981a-419f-8464-617d18e354d6 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.433590 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09ff46-981a-419f-8464-617d18e354d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.433860 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09ff46-981a-419f-8464-617d18e354d6 None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.434581 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09ff46-981a-419f-8464-617d18e354d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:50.434885 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09ff46-981a-419f-8464-617d18e354d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.436351 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09ff46-981a-419f-8464-617d18e354d6 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.453445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 252/505] 10.222.0.58 () {56 vars in 1137 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:50.454238 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09ff46-981a-419f-8464-617d18e354d6 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.471926 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306c171-6057-48b3-92a8-1c98fb7885e2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.508962 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899787e-c711-42d6-9aae-7f40867c5b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.509476 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899787e-c711-42d6-9aae-7f40867c5b8c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.509765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899787e-c711-42d6-9aae-7f40867c5b8c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.510043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899787e-c711-42d6-9aae-7f40867c5b8c None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.510712 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899787e-c711-42d6-9aae-7f40867c5b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:50.511022 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899787e-c711-42d6-9aae-7f40867c5b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.512452 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899787e-c711-42d6-9aae-7f40867c5b8c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.526818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 254/506] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:50.527678 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899787e-c711-42d6-9aae-7f40867c5b8c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.546050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.552615 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.562962 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09ff46-981a-419f-8464-617d18e354d6 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.598487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da4f9d-9c8e-40bb-bb02-869d8f1edb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.599083 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da4f9d-9c8e-40bb-bb02-869d8f1edb07 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.599363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da4f9d-9c8e-40bb-bb02-869d8f1edb07 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.599635 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da4f9d-9c8e-40bb-bb02-869d8f1edb07 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.601590 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da4f9d-9c8e-40bb-bb02-869d8f1edb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:50.601896 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da4f9d-9c8e-40bb-bb02-869d8f1edb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.603279 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da4f9d-9c8e-40bb-bb02-869d8f1edb07 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.614500 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 253/507] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:50.615282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da4f9d-9c8e-40bb-bb02-869d8f1edb07 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.628991 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899787e-c711-42d6-9aae-7f40867c5b8c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.663684 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05481ef6-83b2-4e8f-985e-5b49fb89481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.664319 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05481ef6-83b2-4e8f-985e-5b49fb89481c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.664592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05481ef6-83b2-4e8f-985e-5b49fb89481c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.664860 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05481ef6-83b2-4e8f-985e-5b49fb89481c None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.665607 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05481ef6-83b2-4e8f-985e-5b49fb89481c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:50.665905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05481ef6-83b2-4e8f-985e-5b49fb89481c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.667326 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05481ef6-83b2-4e8f-985e-5b49fb89481c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.703795 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 255/508] 10.222.0.58 () {56 vars in 1137 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:50.704650 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05481ef6-83b2-4e8f-985e-5b49fb89481c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.722385 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da4f9d-9c8e-40bb-bb02-869d8f1edb07 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.756943 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29842829-fa7b-422a-9e3c-a959a6ff1c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.757539 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29842829-fa7b-422a-9e3c-a959a6ff1c3b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.757821 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29842829-fa7b-422a-9e3c-a959a6ff1c3b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.758093 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29842829-fa7b-422a-9e3c-a959a6ff1c3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.776154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.781298 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:50.808224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05481ef6-83b2-4e8f-985e-5b49fb89481c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.830323 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29842829-fa7b-422a-9e3c-a959a6ff1c3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.831784 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29842829-fa7b-422a-9e3c-a959a6ff1c3b None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.842142 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43013466-5209-4ef8-807d-83f0a0d00be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:50.842764 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43013466-5209-4ef8-807d-83f0a0d00be9 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:50.843044 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43013466-5209-4ef8-807d-83f0a0d00be9 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:50.843320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43013466-5209-4ef8-807d-83f0a0d00be9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:50.851508 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43013466-5209-4ef8-807d-83f0a0d00be9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:50.852988 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43013466-5209-4ef8-807d-83f0a0d00be9 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-43013466-5209-4ef8-807d-83f0a0d00be9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:07:50.863787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:50.864848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:50.866362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:50.866362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:50.866362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:07:50.866362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:07:50.866362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:07:50.866362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:07:50.866362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:07:50.866362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:07:50.866362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:07:50.866362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:50.866362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 256/509] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:50.866362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43013466-5209-4ef8-807d-83f0a0d00be9 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.935772 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 254/510] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:50.936643 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29842829-fa7b-422a-9e3c-a959a6ff1c3b None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:50.967303 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43013466-5209-4ef8-807d-83f0a0d00be9 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:50.988217 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.000363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a5676-f292-46bc-a111-97cb117cac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.001018 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a5676-f292-46bc-a111-97cb117cac59 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.001299 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a5676-f292-46bc-a111-97cb117cac59 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.001570 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a5676-f292-46bc-a111-97cb117cac59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.003510 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.009894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a5676-f292-46bc-a111-97cb117cac59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.011600 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a5676-f292-46bc-a111-97cb117cac59 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-447a5676-f292-46bc-a111-97cb117cac59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:07:51.024156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:51.025082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:51.025942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:07:51.025942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:07:51.025942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:07:51.025942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:07:51.025942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:07:51.025942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:07:51.025942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:51.025942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:51.025942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 257/511] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:51.026478 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a5676-f292-46bc-a111-97cb117cac59 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.042085 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29842829-fa7b-422a-9e3c-a959a6ff1c3b None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.078093 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d3cb7-9827-468f-8459-be1b7ef3c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.078691 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d3cb7-9827-468f-8459-be1b7ef3c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.078974 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d3cb7-9827-468f-8459-be1b7ef3c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.079249 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d3cb7-9827-468f-8459-be1b7ef3c5e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.127824 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a5676-f292-46bc-a111-97cb117cac59 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.148027 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d3cb7-9827-468f-8459-be1b7ef3c5e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.149490 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d3cb7-9827-468f-8459-be1b7ef3c5e1 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.162183 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d87adc-c58b-4d24-aba4-734b39fdaccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.163397 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d87adc-c58b-4d24-aba4-734b39fdaccb None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.163682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d87adc-c58b-4d24-aba4-734b39fdaccb None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.164041 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d87adc-c58b-4d24-aba4-734b39fdaccb None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.164769 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d87adc-c58b-4d24-aba4-734b39fdaccb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:51.165077 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d87adc-c58b-4d24-aba4-734b39fdaccb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.166494 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d87adc-c58b-4d24-aba4-734b39fdaccb None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.184001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 258/512] 10.222.0.58 () {56 vars in 1139 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:51.184807 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d87adc-c58b-4d24-aba4-734b39fdaccb None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.201594 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.241107 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.255425 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 255/513] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:51.256395 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d3cb7-9827-468f-8459-be1b7ef3c5e1 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.288824 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d87adc-c58b-4d24-aba4-734b39fdaccb None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.322201 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d325c-a399-427d-8799-2f2b76862b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.322824 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d325c-a399-427d-8799-2f2b76862b97 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.323108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d325c-a399-427d-8799-2f2b76862b97 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.323385 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d325c-a399-427d-8799-2f2b76862b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.333680 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d325c-a399-427d-8799-2f2b76862b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.335855 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d325c-a399-427d-8799-2f2b76862b97 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-bc5d325c-a399-427d-8799-2f2b76862b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:51.350874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:51.351789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:51.352685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:51.352685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:51.352685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:51.353216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 259/514] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:51.354151 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d325c-a399-427d-8799-2f2b76862b97 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.355599 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d3cb7-9827-468f-8459-be1b7ef3c5e1 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.390312 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a02d62-2b0c-474b-a757-167bdb16719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.390909 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a02d62-2b0c-474b-a757-167bdb16719b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.391220 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a02d62-2b0c-474b-a757-167bdb16719b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.391493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a02d62-2b0c-474b-a757-167bdb16719b None admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.392205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a02d62-2b0c-474b-a757-167bdb16719b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:51.392510 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a02d62-2b0c-474b-a757-167bdb16719b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.393939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a02d62-2b0c-474b-a757-167bdb16719b None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.411360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 256/515] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:51.411977 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a02d62-2b0c-474b-a757-167bdb16719b None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.427582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.454081 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d325c-a399-427d-8799-2f2b76862b97 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.456399 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.488591 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91a87e-25a9-4d7f-8d63-0952d5c23100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.489190 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91a87e-25a9-4d7f-8d63-0952d5c23100 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.489473 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91a87e-25a9-4d7f-8d63-0952d5c23100 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.489744 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91a87e-25a9-4d7f-8d63-0952d5c23100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.519661 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a02d62-2b0c-474b-a757-167bdb16719b None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.554979 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607a165-4246-4979-8291-57dd3f95a4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.555607 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607a165-4246-4979-8291-57dd3f95a4fb None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.556013 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607a165-4246-4979-8291-57dd3f95a4fb None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.556318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607a165-4246-4979-8291-57dd3f95a4fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.559243 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91a87e-25a9-4d7f-8d63-0952d5c23100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.560744 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91a87e-25a9-4d7f-8d63-0952d5c23100 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.567885 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607a165-4246-4979-8291-57dd3f95a4fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.569895 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607a165-4246-4979-8291-57dd3f95a4fb None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-f607a165-4246-4979-8291-57dd3f95a4fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:51.584125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:51.585694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:51.586549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:51.586549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:51.586549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:51.586549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 257/516] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:51.586772 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607a165-4246-4979-8291-57dd3f95a4fb None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.650166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.664904 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 260/517] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:07:51.665743 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91a87e-25a9-4d7f-8d63-0952d5c23100 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.668774 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.692151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607a165-4246-4979-8291-57dd3f95a4fb None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.727409 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c57c48-a6c5-4459-9714-9d46eb3cb37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.728046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57c48-a6c5-4459-9714-9d46eb3cb37a None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.728325 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57c48-a6c5-4459-9714-9d46eb3cb37a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.728597 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57c48-a6c5-4459-9714-9d46eb3cb37a None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.729232 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c57c48-a6c5-4459-9714-9d46eb3cb37a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:51.729533 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c57c48-a6c5-4459-9714-9d46eb3cb37a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.730915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c57c48-a6c5-4459-9714-9d46eb3cb37a None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.742052 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 258/518] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:51.742836 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c57c48-a6c5-4459-9714-9d46eb3cb37a None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.766037 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91a87e-25a9-4d7f-8d63-0952d5c23100 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.800939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86895b79-74cc-432a-a720-0d82d01ef5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.801545 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895b79-74cc-432a-a720-0d82d01ef5dc None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.801829 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895b79-74cc-432a-a720-0d82d01ef5dc None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.802102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895b79-74cc-432a-a720-0d82d01ef5dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.803582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86895b79-74cc-432a-a720-0d82d01ef5dc None admin] RBAC: Adding query filter params (role.id=3db17b52a09844b88bc370419f6c6265, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=d43a6040fd95466fa17acdb1f30476ab) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:51.803787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86895b79-74cc-432a-a720-0d82d01ef5dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.805391 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86895b79-74cc-432a-a720-0d82d01ef5dc None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.819881 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 261/519] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/role_assignments?user.id=d43a6040fd95466fa17acdb1f30476ab&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=3db17b52a09844b88bc370419f6c6265 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:51.819881 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86895b79-74cc-432a-a720-0d82d01ef5dc None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.860931 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c57c48-a6c5-4459-9714-9d46eb3cb37a None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.889598 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.889888 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:51.906600 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd4a63-6685-4af1-98bf-19ffe950e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.907216 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd4a63-6685-4af1-98bf-19ffe950e731 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.907493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd4a63-6685-4af1-98bf-19ffe950e731 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.907762 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd4a63-6685-4af1-98bf-19ffe950e731 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.908451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd4a63-6685-4af1-98bf-19ffe950e731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:51.908746 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd4a63-6685-4af1-98bf-19ffe950e731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.910165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd4a63-6685-4af1-98bf-19ffe950e731 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.924222 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 259/520] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:51.930457 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86895b79-74cc-432a-a720-0d82d01ef5dc None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:51.932907 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd4a63-6685-4af1-98bf-19ffe950e731 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:51.967492 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbe20a-8a0e-439b-83b0-e6f5025f14fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:51.968162 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbe20a-8a0e-439b-83b0-e6f5025f14fb None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:51.968441 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbe20a-8a0e-439b-83b0-e6f5025f14fb None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:51.968710 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbe20a-8a0e-439b-83b0-e6f5025f14fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:51.981152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbe20a-8a0e-439b-83b0-e6f5025f14fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:51.982622 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbe20a-8a0e-439b-83b0-e6f5025f14fb None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-b3dbe20a-8a0e-439b-83b0-e6f5025f14fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:51.999025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:52.000361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:52.002273 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:52.002273 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:52.002273 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:52.002273 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 262/521] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:52.002273 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbe20a-8a0e-439b-83b0-e6f5025f14fb None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.051174 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd4a63-6685-4af1-98bf-19ffe950e731 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.092949 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdaece-ccfe-4efb-9998-0c628a361456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.093585 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdaece-ccfe-4efb-9998-0c628a361456 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.093871 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdaece-ccfe-4efb-9998-0c628a361456 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.094545 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdaece-ccfe-4efb-9998-0c628a361456 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.101921 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdaece-ccfe-4efb-9998-0c628a361456 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.103401 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdaece-ccfe-4efb-9998-0c628a361456 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.110494 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbe20a-8a0e-439b-83b0-e6f5025f14fb None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-91bdaece-ccfe-4efb-9998-0c628a361456 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:07:52.115077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:52.116673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:52.117501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:07:52.117501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:07:52.117501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:07:52.117501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:07:52.117501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:07:52.117501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:07:52.117501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:52.117501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:52.117893 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 260/522] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:52.118520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdaece-ccfe-4efb-9998-0c628a361456 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.142236 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:52.159356 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560f319-1d82-4d70-8208-274c0f6322e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.160048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f319-1d82-4d70-8208-274c0f6322e5 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.160332 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f319-1d82-4d70-8208-274c0f6322e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.160608 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560f319-1d82-4d70-8208-274c0f6322e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.167443 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:52.168433 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560f319-1d82-4d70-8208-274c0f6322e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.169941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560f319-1d82-4d70-8208-274c0f6322e5 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-f560f319-1d82-4d70-8208-274c0f6322e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:07:52.181925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:52.182792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:52.183636 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:07:52.183636 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:07:52.183636 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:07:52.183636 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:07:52.183636 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:07:52.183636 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:07:52.183636 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:52.183636 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:52.183636 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 263/523] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:52.184131 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560f319-1d82-4d70-8208-274c0f6322e5 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.245162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdaece-ccfe-4efb-9998-0c628a361456 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.281796 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05433cb-11a9-42cc-ad5e-5cdc5a76d8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.282511 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05433cb-11a9-42cc-ad5e-5cdc5a76d8d9 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.282853 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05433cb-11a9-42cc-ad5e-5cdc5a76d8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.283190 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05433cb-11a9-42cc-ad5e-5cdc5a76d8d9 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.283940 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05433cb-11a9-42cc-ad5e-5cdc5a76d8d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:52.284309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05433cb-11a9-42cc-ad5e-5cdc5a76d8d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.285674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05433cb-11a9-42cc-ad5e-5cdc5a76d8d9 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.299573 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 261/524] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:52.300434 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05433cb-11a9-42cc-ad5e-5cdc5a76d8d9 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.310249 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560f319-1d82-4d70-8208-274c0f6322e5 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.347446 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34925a9c-f45d-42c4-ac48-9982365ed705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.347991 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34925a9c-f45d-42c4-ac48-9982365ed705 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.348266 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34925a9c-f45d-42c4-ac48-9982365ed705 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.348545 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34925a9c-f45d-42c4-ac48-9982365ed705 None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.349225 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34925a9c-f45d-42c4-ac48-9982365ed705 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:52.349531 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34925a9c-f45d-42c4-ac48-9982365ed705 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.352104 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34925a9c-f45d-42c4-ac48-9982365ed705 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.371533 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 264/525] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:52.372404 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34925a9c-f45d-42c4-ac48-9982365ed705 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.417264 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05433cb-11a9-42cc-ad5e-5cdc5a76d8d9 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.418234 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:52.419490 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:52.455027 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16d744-093e-46a7-b710-882119e58319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.455637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16d744-093e-46a7-b710-882119e58319 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.455955 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16d744-093e-46a7-b710-882119e58319 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.456274 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16d744-093e-46a7-b710-882119e58319 None admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.456975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16d744-093e-46a7-b710-882119e58319 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:52.457290 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16d744-093e-46a7-b710-882119e58319 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.458753 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16d744-093e-46a7-b710-882119e58319 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.476158 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 262/526] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:52.476972 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16d744-093e-46a7-b710-882119e58319 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.483522 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34925a9c-f45d-42c4-ac48-9982365ed705 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.519806 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe89e-db72-4d12-a6de-e377a20ccdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.520540 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe89e-db72-4d12-a6de-e377a20ccdd2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.520890 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe89e-db72-4d12-a6de-e377a20ccdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.521224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffe89e-db72-4d12-a6de-e377a20ccdd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.528499 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffe89e-db72-4d12-a6de-e377a20ccdd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.531429 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffe89e-db72-4d12-a6de-e377a20ccdd2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-65ffe89e-db72-4d12-a6de-e377a20ccdd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:07:52.544235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:52.545308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:52.546380 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:07:52.546380 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:07:52.546380 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:07:52.546380 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:07:52.546380 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:07:52.546380 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:07:52.546380 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:52.546380 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:52.551956 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 265/527] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:52.551956 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe89e-db72-4d12-a6de-e377a20ccdd2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.609051 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16d744-093e-46a7-b710-882119e58319 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.647467 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff9340-4b4b-4d10-b410-8084a2c62e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.648201 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff9340-4b4b-4d10-b410-8084a2c62e16 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.648353 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:52.648812 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff9340-4b4b-4d10-b410-8084a2c62e16 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.648928 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff9340-4b4b-4d10-b410-8084a2c62e16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.649582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff9340-4b4b-4d10-b410-8084a2c62e16 None admin] RBAC: Adding query filter params (role.id=3db17b52a09844b88bc370419f6c6265, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=18eb03a1a720431a9c78883a0aab8741) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:52.649959 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff9340-4b4b-4d10-b410-8084a2c62e16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.651534 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff9340-4b4b-4d10-b410-8084a2c62e16 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.652104 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffe89e-db72-4d12-a6de-e377a20ccdd2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.661113 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 263/528] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/role_assignments?user.id=18eb03a1a720431a9c78883a0aab8741&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=3db17b52a09844b88bc370419f6c6265 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:52.662078 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff9340-4b4b-4d10-b410-8084a2c62e16 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.702315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e73c1-35cf-400d-9b40-fbdb6755a9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.703250 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e73c1-35cf-400d-9b40-fbdb6755a9ba None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.704059 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:52.704505 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e73c1-35cf-400d-9b40-fbdb6755a9ba None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.704927 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e73c1-35cf-400d-9b40-fbdb6755a9ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.705998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e73c1-35cf-400d-9b40-fbdb6755a9ba None admin] RBAC: Adding query filter params (role.id=3db17b52a09844b88bc370419f6c6265, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=60819c30ec7c42d1a1891e7ce07f8473) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:52.706456 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e73c1-35cf-400d-9b40-fbdb6755a9ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.708192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e73c1-35cf-400d-9b40-fbdb6755a9ba None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.721533 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 266/529] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/role_assignments?user.id=60819c30ec7c42d1a1891e7ce07f8473&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=3db17b52a09844b88bc370419f6c6265 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:52.805763 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff9340-4b4b-4d10-b410-8084a2c62e16 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:52.848114 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17197953-e79b-4c31-844f-09d45dc8f5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:52.848744 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17197953-e79b-4c31-844f-09d45dc8f5d0 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:52.849028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17197953-e79b-4c31-844f-09d45dc8f5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:52.849297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17197953-e79b-4c31-844f-09d45dc8f5d0 None admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:52.850192 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17197953-e79b-4c31-844f-09d45dc8f5d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:52.850621 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17197953-e79b-4c31-844f-09d45dc8f5d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:52.852170 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17197953-e79b-4c31-844f-09d45dc8f5d0 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:52.868335 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 264/530] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:52.874306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e73c1-35cf-400d-9b40-fbdb6755a9ba None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:52.995793 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e73c1-35cf-400d-9b40-fbdb6755a9ba None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:53.031153 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee0fab-68f7-4fc8-8398-8d292338f7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:53.032063 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee0fab-68f7-4fc8-8398-8d292338f7a7 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:53.032494 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee0fab-68f7-4fc8-8398-8d292338f7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:53.032913 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee0fab-68f7-4fc8-8398-8d292338f7a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:53.033841 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee0fab-68f7-4fc8-8398-8d292338f7a7 None admin] RBAC: Adding query filter params (role.id=3db17b52a09844b88bc370419f6c6265, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=b57524e5da8647a1a258f8c1e4258b62) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:53.034299 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee0fab-68f7-4fc8-8398-8d292338f7a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:53.036044 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee0fab-68f7-4fc8-8398-8d292338f7a7 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:53.043294 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 267/531] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:07:52 2022] GET /identity/v3/role_assignments?user.id=b57524e5da8647a1a258f8c1e4258b62&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=3db17b52a09844b88bc370419f6c6265 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:54.032980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b6349-bf1e-4a53-910f-31244b6daeaf None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:54.033492 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b6349-bf1e-4a53-910f-31244b6daeaf None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:54.033492 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b6349-bf1e-4a53-910f-31244b6daeaf None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:54.035111 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 265/532] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:54.040535 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0787259-7a68-463c-8df0-70dbe347dfaf None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:54.040920 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0787259-7a68-463c-8df0-70dbe347dfaf None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:54.041083 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0787259-7a68-463c-8df0-70dbe347dfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:54.059572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-b0787259-7a68-463c-8df0-70dbe347dfaf None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:54.060806 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-b0787259-7a68-463c-8df0-70dbe347dfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:54.085138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:54.134795 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 268/533] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:54.475389 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b6349-bf1e-4a53-910f-31244b6daeaf None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:54.569284 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:54.587548 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b6349-bf1e-4a53-910f-31244b6daeaf None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:54.623423 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83544e88-d415-4a25-9d99-dfed4015547f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:54.624096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83544e88-d415-4a25-9d99-dfed4015547f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:54.624374 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83544e88-d415-4a25-9d99-dfed4015547f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:54.624648 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83544e88-d415-4a25-9d99-dfed4015547f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:54.635919 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83544e88-d415-4a25-9d99-dfed4015547f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-83544e88-d415-4a25-9d99-dfed4015547f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:54.640531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:54.641402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:54.642185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 266/534] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:07:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:54.648423 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0787259-7a68-463c-8df0-70dbe347dfaf None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:54.754982 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0787259-7a68-463c-8df0-70dbe347dfaf None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:54.796057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe7bdf-c70c-482a-a2ea-391749c473ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:54.796686 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe7bdf-c70c-482a-a2ea-391749c473ae None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:54.796962 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe7bdf-c70c-482a-a2ea-391749c473ae None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:54.797230 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe7bdf-c70c-482a-a2ea-391749c473ae None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:54.797924 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe7bdf-c70c-482a-a2ea-391749c473ae None admin] RBAC: Adding query filter params (name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:54.798220 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe7bdf-c70c-482a-a2ea-391749c473ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:54.799665 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe7bdf-c70c-482a-a2ea-391749c473ae None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:54.814247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 269/535] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:07:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:54.816240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83544e88-d415-4a25-9d99-dfed4015547f None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:54.927665 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83544e88-d415-4a25-9d99-dfed4015547f None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:54.966865 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cbafe-f31d-4bd7-88e8-7755bb2e8f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:54.967500 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cbafe-f31d-4bd7-88e8-7755bb2e8f95 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:54.967787 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cbafe-f31d-4bd7-88e8-7755bb2e8f95 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:54.968079 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cbafe-f31d-4bd7-88e8-7755bb2e8f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:54.974617 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25a3e9-dfaf-4cc0-9386-f3ed918b2929 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:54.975852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25a3e9-dfaf-4cc0-9386-f3ed918b2929 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:54.976331 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25a3e9-dfaf-4cc0-9386-f3ed918b2929 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:54.981792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cbafe-f31d-4bd7-88e8-7755bb2e8f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:54.981792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cbafe-f31d-4bd7-88e8-7755bb2e8f95 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:54.982186 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 270/536] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:54.984064 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefdf2e-ce2e-4ec4-81cb-aa554b818212 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:54.984569 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefdf2e-ce2e-4ec4-81cb-aa554b818212 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:54.985039 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefdf2e-ce2e-4ec4-81cb-aa554b818212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:54.988607 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-3a9cbafe-f31d-4bd7-88e8-7755bb2e8f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:54.998123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:54.999223 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:55.000338 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:55.000338 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:55.000338 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:55.002285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 267/537] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:55.009541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cbafe-f31d-4bd7-88e8-7755bb2e8f95 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:55.012964 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-caefdf2e-ce2e-4ec4-81cb-aa554b818212 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:55.014652 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-caefdf2e-ce2e-4ec4-81cb-aa554b818212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:55.031882 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:55.107160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 271/538] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:55.110079 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3c781-e658-4002-9553-b9854a809ace None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.110847 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3c781-e658-4002-9553-b9854a809ace None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.111355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3c781-e658-4002-9553-b9854a809ace None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.117361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 272/539] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:55.120571 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844386-4916-4ee6-8d98-43e13399ad88 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.120855 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844386-4916-4ee6-8d98-43e13399ad88 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.121124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844386-4916-4ee6-8d98-43e13399ad88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.130168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cbafe-f31d-4bd7-88e8-7755bb2e8f95 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:55.144668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-71844386-4916-4ee6-8d98-43e13399ad88 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:55.147532 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-71844386-4916-4ee6-8d98-43e13399ad88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:55.173333 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b9596-5d9e-4327-b8d9-df28ef651bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:55.173953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b9596-5d9e-4327-b8d9-df28ef651bda None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.174236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b9596-5d9e-4327-b8d9-df28ef651bda None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.174611 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b9596-5d9e-4327-b8d9-df28ef651bda None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.175374 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b9596-5d9e-4327-b8d9-df28ef651bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:55.175681 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b9596-5d9e-4327-b8d9-df28ef651bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:55.177181 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b9596-5d9e-4327-b8d9-df28ef651bda None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:55.193542 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 268/540] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:55.200255 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b9596-5d9e-4327-b8d9-df28ef651bda None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:55.231089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 273/541] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:55.267896 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:55.315307 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b9596-5d9e-4327-b8d9-df28ef651bda None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:55.349467 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa0973-6255-41e5-86ff-d6d07fc9357f None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.350292 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa0973-6255-41e5-86ff-d6d07fc9357f None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.350679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa0973-6255-41e5-86ff-d6d07fc9357f None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.352289 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 274/542] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:07:55.353673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c4c02-ee8e-4ee9-a705-16949db2811b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:55.354591 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c4c02-ee8e-4ee9-a705-16949db2811b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.355068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c4c02-ee8e-4ee9-a705-16949db2811b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.355530 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c4c02-ee8e-4ee9-a705-16949db2811b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.357061 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a189e-e711-4205-864d-c3ff42380088 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.357348 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a189e-e711-4205-864d-c3ff42380088 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.357626 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a189e-e711-4205-864d-c3ff42380088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.365261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c4c02-ee8e-4ee9-a705-16949db2811b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:55.367534 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c4c02-ee8e-4ee9-a705-16949db2811b None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:55.376013 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-1f6a189e-e711-4205-864d-c3ff42380088 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:55.377204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-1f6a189e-e711-4205-864d-c3ff42380088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-278c4c02-ee8e-4ee9-a705-16949db2811b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:07:55.380996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:55.382373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:55.383348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:55.383348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:55.383348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:07:55.383348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:07:55.383348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:07:55.383348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:07:55.383348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:07:55.383348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:07:55.383348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:07:55.383348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:55.390404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 269/543] 10.222.0.58 () {56 vars in 1093 bytes} [Tue Aug 23 22:07:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:55.392107 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c4c02-ee8e-4ee9-a705-16949db2811b None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:55.457043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 275/544] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:07:55.457743 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a189e-e711-4205-864d-c3ff42380088 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:55.470484 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:55.532098 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c4c02-ee8e-4ee9-a705-16949db2811b None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:55.551456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:55.572543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf472ae-6218-4a0e-a419-f3ae750465c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:55.573148 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf472ae-6218-4a0e-a419-f3ae750465c9 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.573431 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf472ae-6218-4a0e-a419-f3ae750465c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.573705 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf472ae-6218-4a0e-a419-f3ae750465c9 None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.574483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf472ae-6218-4a0e-a419-f3ae750465c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:55.574790 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf472ae-6218-4a0e-a419-f3ae750465c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:55.576395 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf472ae-6218-4a0e-a419-f3ae750465c9 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:55.581280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a189e-e711-4205-864d-c3ff42380088 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:55.597660 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 270/545] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Aug 23 22:07:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:07:55.598573 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf472ae-6218-4a0e-a419-f3ae750465c9 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:55.623106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f69c5-b25f-4873-9e96-43505c9daa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:55.623737 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f69c5-b25f-4873-9e96-43505c9daa7d None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.624052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f69c5-b25f-4873-9e96-43505c9daa7d None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.624333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f69c5-b25f-4873-9e96-43505c9daa7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.635371 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f69c5-b25f-4873-9e96-43505c9daa7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-391f69c5-b25f-4873-9e96-43505c9daa7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:55.640073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:55.641059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:55.641849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 276/546] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:07:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:55.642523 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f69c5-b25f-4873-9e96-43505c9daa7d None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:55.708891 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf472ae-6218-4a0e-a419-f3ae750465c9 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:55.715063 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:55.747115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c195570-b404-48a2-a9d2-05e0043e8a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:55.747341 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f69c5-b25f-4873-9e96-43505c9daa7d None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:55.747747 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c195570-b404-48a2-a9d2-05e0043e8a4f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.748076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c195570-b404-48a2-a9d2-05e0043e8a4f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.748350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c195570-b404-48a2-a9d2-05e0043e8a4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.759752 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c195570-b404-48a2-a9d2-05e0043e8a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-1c195570-b404-48a2-a9d2-05e0043e8a4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:55.764930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:55.765996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 271/547] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:07:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:55.772094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c195570-b404-48a2-a9d2-05e0043e8a4f None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:55.788463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ca39-f83a-488e-994e-022ac926a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:55.789128 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ca39-f83a-488e-994e-022ac926a4bf None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.789411 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ca39-f83a-488e-994e-022ac926a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.789685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231ca39-f83a-488e-994e-022ac926a4bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.800561 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231ca39-f83a-488e-994e-022ac926a4bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:55.802038 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231ca39-f83a-488e-994e-022ac926a4bf None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:55.808031 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-2231ca39-f83a-488e-994e-022ac926a4bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:55.817198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:55.818091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:55.819640 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:55.819640 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:55.819640 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:55.819640 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 277/548] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:55.819875 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ca39-f83a-488e-994e-022ac926a4bf None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:55.879795 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c195570-b404-48a2-a9d2-05e0043e8a4f None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:55.917771 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467126aa-371d-4b74-9543-34bdffe84f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:55.918389 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467126aa-371d-4b74-9543-34bdffe84f6b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.919083 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467126aa-371d-4b74-9543-34bdffe84f6b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.919365 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467126aa-371d-4b74-9543-34bdffe84f6b None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.920083 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467126aa-371d-4b74-9543-34bdffe84f6b None admin] RBAC: Adding query filter params (name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:55.920394 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467126aa-371d-4b74-9543-34bdffe84f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:55.921773 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467126aa-371d-4b74-9543-34bdffe84f6b None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:55.930292 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 272/549] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:07:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:55.931075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467126aa-371d-4b74-9543-34bdffe84f6b None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:55.933777 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231ca39-f83a-488e-994e-022ac926a4bf None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:55.957818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:55.970477 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a4aa1-be49-4adb-90ad-f0bcb15b6693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:55.971077 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a4aa1-be49-4adb-90ad-f0bcb15b6693 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:55.971353 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a4aa1-be49-4adb-90ad-f0bcb15b6693 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:55.971626 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a4aa1-be49-4adb-90ad-f0bcb15b6693 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:55.972310 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a4aa1-be49-4adb-90ad-f0bcb15b6693 None admin] RBAC: Adding query filter params (name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:55.972609 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a4aa1-be49-4adb-90ad-f0bcb15b6693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:55.973975 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a4aa1-be49-4adb-90ad-f0bcb15b6693 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:55.982718 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 278/550] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:07:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:55.983514 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a4aa1-be49-4adb-90ad-f0bcb15b6693 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.043092 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.047041 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467126aa-371d-4b74-9543-34bdffe84f6b None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.081816 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ef67e-c317-424c-8347-061f33c77406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.082439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ef67e-c317-424c-8347-061f33c77406 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.082585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a4aa1-be49-4adb-90ad-f0bcb15b6693 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.082738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ef67e-c317-424c-8347-061f33c77406 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.082986 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ef67e-c317-424c-8347-061f33c77406 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.093597 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ef67e-c317-424c-8347-061f33c77406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-bb8ef67e-c317-424c-8347-061f33c77406 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:07:56.098980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:56.100215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 273/551] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:07:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:56.101173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ef67e-c317-424c-8347-061f33c77406 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.120633 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e4cb0-87ff-4015-9dd4-b9d18254480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.121300 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e4cb0-87ff-4015-9dd4-b9d18254480c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.121663 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e4cb0-87ff-4015-9dd4-b9d18254480c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.121989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e4cb0-87ff-4015-9dd4-b9d18254480c None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.122657 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e4cb0-87ff-4015-9dd4-b9d18254480c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:56.122963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e4cb0-87ff-4015-9dd4-b9d18254480c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.124381 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e4cb0-87ff-4015-9dd4-b9d18254480c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.140481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 279/552] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:56.141286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e4cb0-87ff-4015-9dd4-b9d18254480c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.190683 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.216995 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ef67e-c317-424c-8347-061f33c77406 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.246507 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e4cb0-87ff-4015-9dd4-b9d18254480c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.253542 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc4a8a-9c0b-4c0b-bde4-36f160d7fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.254165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc4a8a-9c0b-4c0b-bde4-36f160d7fbfe None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.254443 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc4a8a-9c0b-4c0b-bde4-36f160d7fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.254736 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc4a8a-9c0b-4c0b-bde4-36f160d7fbfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.266430 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc4a8a-9c0b-4c0b-bde4-36f160d7fbfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.267922 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc4a8a-9c0b-4c0b-bde4-36f160d7fbfe None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.281485 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466439f-e073-4e09-8db9-b2971f695d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.282112 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466439f-e073-4e09-8db9-b2971f695d4f None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.282403 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466439f-e073-4e09-8db9-b2971f695d4f None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-47dc4a8a-9c0b-4c0b-bde4-36f160d7fbfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:56.282520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:56.283414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:56.284800 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:56.284800 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:56.284800 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:56.284981 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466439f-e073-4e09-8db9-b2971f695d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.285056 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 274/553] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:56.285056 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc4a8a-9c0b-4c0b-bde4-36f160d7fbfe None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.297596 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466439f-e073-4e09-8db9-b2971f695d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.298639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.298994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466439f-e073-4e09-8db9-b2971f695d4f None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-4466439f-e073-4e09-8db9-b2971f695d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:56.314922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:56.316184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:56.317037 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:56.317037 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:56.317037 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:56.317037 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 280/554] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:56.317259 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466439f-e073-4e09-8db9-b2971f695d4f None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.395348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc4a8a-9c0b-4c0b-bde4-36f160d7fbfe None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.413260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.419377 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466439f-e073-4e09-8db9-b2971f695d4f None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.430356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c438a6-fb5b-45ba-b935-3f5e2d65f34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.430959 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c438a6-fb5b-45ba-b935-3f5e2d65f34d None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.431242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c438a6-fb5b-45ba-b935-3f5e2d65f34d None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.431511 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c438a6-fb5b-45ba-b935-3f5e2d65f34d None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.432196 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c438a6-fb5b-45ba-b935-3f5e2d65f34d None admin] RBAC: Adding query filter params (name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:56.432496 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c438a6-fb5b-45ba-b935-3f5e2d65f34d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.433857 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c438a6-fb5b-45ba-b935-3f5e2d65f34d None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.441554 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 275/555] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:56.442327 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c438a6-fb5b-45ba-b935-3f5e2d65f34d None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.459287 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684d340-4ce9-4037-b2b9-ed2ef4af1771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.460121 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684d340-4ce9-4037-b2b9-ed2ef4af1771 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.460405 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684d340-4ce9-4037-b2b9-ed2ef4af1771 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.460680 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684d340-4ce9-4037-b2b9-ed2ef4af1771 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.467334 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684d340-4ce9-4037-b2b9-ed2ef4af1771 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.468794 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684d340-4ce9-4037-b2b9-ed2ef4af1771 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-b684d340-4ce9-4037-b2b9-ed2ef4af1771 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:07:56.480265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:56.481238 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:56.482111 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:07:56.482111 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:07:56.482111 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:07:56.482111 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:07:56.482111 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:07:56.482111 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:07:56.482111 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:56.482111 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:56.482111 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 281/556] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:56.482596 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684d340-4ce9-4037-b2b9-ed2ef4af1771 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.517077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.553068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c438a6-fb5b-45ba-b935-3f5e2d65f34d None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.583306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684d340-4ce9-4037-b2b9-ed2ef4af1771 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.587846 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c59539-4c6f-413b-bb33-02a7caa8b372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.588469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c59539-4c6f-413b-bb33-02a7caa8b372 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.588746 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c59539-4c6f-413b-bb33-02a7caa8b372 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.589016 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c59539-4c6f-413b-bb33-02a7caa8b372 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.589654 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c59539-4c6f-413b-bb33-02a7caa8b372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:56.589955 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c59539-4c6f-413b-bb33-02a7caa8b372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.591337 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c59539-4c6f-413b-bb33-02a7caa8b372 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.608548 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 276/557] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:56.608548 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c59539-4c6f-413b-bb33-02a7caa8b372 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.618822 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59058e4-ab4e-42aa-9240-0532697e25ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.619422 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59058e4-ab4e-42aa-9240-0532697e25ec None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.619701 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59058e4-ab4e-42aa-9240-0532697e25ec None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.620000 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59058e4-ab4e-42aa-9240-0532697e25ec None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.620629 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59058e4-ab4e-42aa-9240-0532697e25ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:56.620934 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59058e4-ab4e-42aa-9240-0532697e25ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.622298 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59058e4-ab4e-42aa-9240-0532697e25ec None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.634096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 282/558] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:56.634884 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59058e4-ab4e-42aa-9240-0532697e25ec None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.653942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.712286 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c59539-4c6f-413b-bb33-02a7caa8b372 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.738019 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59058e4-ab4e-42aa-9240-0532697e25ec None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.746208 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.751692 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451822cb-2165-4163-a2d4-449886212d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.752521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451822cb-2165-4163-a2d4-449886212d31 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.752805 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451822cb-2165-4163-a2d4-449886212d31 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.753083 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451822cb-2165-4163-a2d4-449886212d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.763024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451822cb-2165-4163-a2d4-449886212d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.764524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451822cb-2165-4163-a2d4-449886212d31 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.773542 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dad60-45db-4997-9605-7c837e1cefa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.774140 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dad60-45db-4997-9605-7c837e1cefa6 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.774423 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dad60-45db-4997-9605-7c837e1cefa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.774694 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dad60-45db-4997-9605-7c837e1cefa6 None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.775374 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dad60-45db-4997-9605-7c837e1cefa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:56.775880 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dad60-45db-4997-9605-7c837e1cefa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.777116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dad60-45db-4997-9605-7c837e1cefa6 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-451822cb-2165-4163-a2d4-449886212d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:56.778867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:56.779792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:56.780752 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:56.780752 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:56.780752 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:56.780752 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 277/559] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:56.780981 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451822cb-2165-4163-a2d4-449886212d31 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.791652 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 283/560] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:56.792492 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dad60-45db-4997-9605-7c837e1cefa6 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.871894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:56.892208 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451822cb-2165-4163-a2d4-449886212d31 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.895256 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dad60-45db-4997-9605-7c837e1cefa6 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:56.925385 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f336458-ca2d-4174-94f5-bef76ddf0714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.926345 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336458-ca2d-4174-94f5-bef76ddf0714 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.926627 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336458-ca2d-4174-94f5-bef76ddf0714 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.926901 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336458-ca2d-4174-94f5-bef76ddf0714 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.930280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280f545-36b1-40d6-b61e-3cb6573623fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:56.930896 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280f545-36b1-40d6-b61e-3cb6573623fb None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:56.931168 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280f545-36b1-40d6-b61e-3cb6573623fb None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:56.931436 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280f545-36b1-40d6-b61e-3cb6573623fb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:56.936817 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f336458-ca2d-4174-94f5-bef76ddf0714 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.938280 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f336458-ca2d-4174-94f5-bef76ddf0714 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.938455 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280f545-36b1-40d6-b61e-3cb6573623fb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:56.939905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280f545-36b1-40d6-b61e-3cb6573623fb None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-5f336458-ca2d-4174-94f5-bef76ddf0714 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:07:56.949309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:56.950483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:56.951628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:56.951628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:56.951628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:07:56.951628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:07:56.951628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:07:56.951628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:07:56.951628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:07:56.951628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:07:56.951628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:07:56.951628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:56.951628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 278/561] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:56.951628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f336458-ca2d-4174-94f5-bef76ddf0714 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-6280f545-36b1-40d6-b61e-3cb6573623fb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:07:56.952370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:56.953210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:56.954315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:56.954315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:56.954315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:07:56.954315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:07:56.954315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:07:56.954315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:07:56.954315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:07:56.954315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:07:56.954315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:07:56.954315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:56.956154 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 284/562] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:56.957078 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280f545-36b1-40d6-b61e-3cb6573623fb None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.001260 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.057055 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280f545-36b1-40d6-b61e-3cb6573623fb None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.057811 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f336458-ca2d-4174-94f5-bef76ddf0714 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.090030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4947f8-ce76-4165-b5a7-09da13f5ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.090672 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4947f8-ce76-4165-b5a7-09da13f5ba0a None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.090948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4947f8-ce76-4165-b5a7-09da13f5ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.091050 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a1bcb-c8c9-47ce-a834-463bb2391b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.091220 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4947f8-ce76-4165-b5a7-09da13f5ba0a None admin] PATH_INFO: `/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/d43a6040fd95466fa17acdb1f30476ab/roles/3db17b52a09844b88bc370419f6c6265` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.091541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a1bcb-c8c9-47ce-a834-463bb2391b8d None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.091822 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a1bcb-c8c9-47ce-a834-463bb2391b8d None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.092122 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a1bcb-c8c9-47ce-a834-463bb2391b8d None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.092756 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a1bcb-c8c9-47ce-a834-463bb2391b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:57.093059 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a1bcb-c8c9-47ce-a834-463bb2391b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.094650 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.094786 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a1bcb-c8c9-47ce-a834-463bb2391b8d None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.107153 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 279/563] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:57.107641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4947f8-ce76-4165-b5a7-09da13f5ba0a None admin] RBAC: Authorizing `identity:create_grant(project_id=0d86eb186aa94e1bb4a358cfc19447b1, user_id=d43a6040fd95466fa17acdb1f30476ab, role_id=3db17b52a09844b88bc370419f6c6265)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.107988 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a1bcb-c8c9-47ce-a834-463bb2391b8d None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.109111 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4947f8-ce76-4165-b5a7-09da13f5ba0a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.123287 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 285/564] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:56 2022] PUT /identity/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/d43a6040fd95466fa17acdb1f30476ab/roles/3db17b52a09844b88bc370419f6c6265 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:57.124025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4947f8-ce76-4165-b5a7-09da13f5ba0a None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.238445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a1bcb-c8c9-47ce-a834-463bb2391b8d None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.242943 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.255864 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4947f8-ce76-4165-b5a7-09da13f5ba0a None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.279439 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21379-1838-43c4-af09-60f51cdfea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.280214 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21379-1838-43c4-af09-60f51cdfea1d None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.280930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21379-1838-43c4-af09-60f51cdfea1d None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.281203 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21379-1838-43c4-af09-60f51cdfea1d None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.281946 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b21379-1838-43c4-af09-60f51cdfea1d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:57.282251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b21379-1838-43c4-af09-60f51cdfea1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.283710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b21379-1838-43c4-af09-60f51cdfea1d None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.298515 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20e92c-cf9b-4f99-91e6-7e0c6fbee027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.299491 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20e92c-cf9b-4f99-91e6-7e0c6fbee027 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.299491 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20e92c-cf9b-4f99-91e6-7e0c6fbee027 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.299770 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20e92c-cf9b-4f99-91e6-7e0c6fbee027 None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.300877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20e92c-cf9b-4f99-91e6-7e0c6fbee027 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:57.300877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20e92c-cf9b-4f99-91e6-7e0c6fbee027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.302220 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20e92c-cf9b-4f99-91e6-7e0c6fbee027 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.308496 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 280/565] 10.222.0.58 () {56 vars in 1137 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:57.309304 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21379-1838-43c4-af09-60f51cdfea1d None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.324213 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 286/566] 10.222.0.58 () {56 vars in 1137 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:57.325363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20e92c-cf9b-4f99-91e6-7e0c6fbee027 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.375177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.416284 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21379-1838-43c4-af09-60f51cdfea1d None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.435893 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20e92c-cf9b-4f99-91e6-7e0c6fbee027 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.454138 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565720c-705b-4e9c-ab47-10d5179c29c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.454750 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565720c-705b-4e9c-ab47-10d5179c29c6 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.455027 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565720c-705b-4e9c-ab47-10d5179c29c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.455295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565720c-705b-4e9c-ab47-10d5179c29c6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.462608 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565720c-705b-4e9c-ab47-10d5179c29c6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.464083 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565720c-705b-4e9c-ab47-10d5179c29c6 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.471973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65e47-4012-4c53-b7c6-4f581d746197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.472604 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65e47-4012-4c53-b7c6-4f581d746197 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.472885 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65e47-4012-4c53-b7c6-4f581d746197 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.473157 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65e47-4012-4c53-b7c6-4f581d746197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-b565720c-705b-4e9c-ab47-10d5179c29c6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:07:57.476494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:57.477404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:57.478336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:57.478336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:57.478336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:07:57.478336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:07:57.478336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:07:57.478336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:07:57.478336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:07:57.478336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:07:57.478336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:07:57.478336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:57.478336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 281/567] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:57.478937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565720c-705b-4e9c-ab47-10d5179c29c6 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.490167 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65e47-4012-4c53-b7c6-4f581d746197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.492320 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65e47-4012-4c53-b7c6-4f581d746197 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.504247 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-0eb65e47-4012-4c53-b7c6-4f581d746197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:57.507101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:57.508048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:57.508923 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:57.508923 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:57.508923 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:57.508923 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 287/568] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:57.509151 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65e47-4012-4c53-b7c6-4f581d746197 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.587222 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565720c-705b-4e9c-ab47-10d5179c29c6 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.613846 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.620949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65e47-4012-4c53-b7c6-4f581d746197 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.627520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12c2d1-b366-4cbe-81b0-5d0d8ad90700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.628106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12c2d1-b366-4cbe-81b0-5d0d8ad90700 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.628388 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12c2d1-b366-4cbe-81b0-5d0d8ad90700 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.628666 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12c2d1-b366-4cbe-81b0-5d0d8ad90700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.641466 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12c2d1-b366-4cbe-81b0-5d0d8ad90700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.642921 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12c2d1-b366-4cbe-81b0-5d0d8ad90700 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.656577 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd03fb-cd3e-4adc-88ea-f3fb067f192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.657178 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd03fb-cd3e-4adc-88ea-f3fb067f192b None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.657459 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd03fb-cd3e-4adc-88ea-f3fb067f192b None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.657730 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd03fb-cd3e-4adc-88ea-f3fb067f192b None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-1f12c2d1-b366-4cbe-81b0-5d0d8ad90700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:57.657937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:57.658833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:57.665205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:57.665205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:57.665205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:57.665410 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd03fb-cd3e-4adc-88ea-f3fb067f192b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:57.665410 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd03fb-cd3e-4adc-88ea-f3fb067f192b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.665574 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 282/569] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:57.665574 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12c2d1-b366-4cbe-81b0-5d0d8ad90700 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.665729 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd03fb-cd3e-4adc-88ea-f3fb067f192b None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.683400 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 288/570] 10.222.0.58 () {56 vars in 1139 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:57.684574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd03fb-cd3e-4adc-88ea-f3fb067f192b None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.752462 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.780351 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12c2d1-b366-4cbe-81b0-5d0d8ad90700 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.792049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd03fb-cd3e-4adc-88ea-f3fb067f192b None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.816860 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764ce58-162c-4463-98b0-74907656eb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.817471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764ce58-162c-4463-98b0-74907656eb84 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.817762 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764ce58-162c-4463-98b0-74907656eb84 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.818041 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764ce58-162c-4463-98b0-74907656eb84 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.819287 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764ce58-162c-4463-98b0-74907656eb84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:57.819598 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764ce58-162c-4463-98b0-74907656eb84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.821010 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764ce58-162c-4463-98b0-74907656eb84 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.828354 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f920d-7967-47f4-ba18-d4f28acf57ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.828952 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f920d-7967-47f4-ba18-d4f28acf57ec None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.829228 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f920d-7967-47f4-ba18-d4f28acf57ec None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.829494 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f920d-7967-47f4-ba18-d4f28acf57ec None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.830156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f920d-7967-47f4-ba18-d4f28acf57ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:57.830426 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f920d-7967-47f4-ba18-d4f28acf57ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.831780 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f920d-7967-47f4-ba18-d4f28acf57ec None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.837624 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 283/571] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:57.837624 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764ce58-162c-4463-98b0-74907656eb84 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.854099 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 289/572] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:57.854099 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f920d-7967-47f4-ba18-d4f28acf57ec None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:57.870994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.944840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764ce58-162c-4463-98b0-74907656eb84 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.957600 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f920d-7967-47f4-ba18-d4f28acf57ec None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:57.980032 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fc91e-079e-4cf0-999b-d58587debbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.980755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fc91e-079e-4cf0-999b-d58587debbb8 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.981037 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fc91e-079e-4cf0-999b-d58587debbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.981311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fc91e-079e-4cf0-999b-d58587debbb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:57.983189 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:57.993213 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fc91e-079e-4cf0-999b-d58587debbb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:57.994684 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fc91e-079e-4cf0-999b-d58587debbb8 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:57.995251 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0101c5-21b1-4f16-adfc-7a44a2166a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:57.995875 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0101c5-21b1-4f16-adfc-7a44a2166a22 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:57.996148 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0101c5-21b1-4f16-adfc-7a44a2166a22 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:57.996419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0101c5-21b1-4f16-adfc-7a44a2166a22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.002897 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0101c5-21b1-4f16-adfc-7a44a2166a22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:58.004358 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0101c5-21b1-4f16-adfc-7a44a2166a22 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-df9fc91e-079e-4cf0-999b-d58587debbb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:07:58.010276 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:58.011197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:07:58.012711 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:07:58.012711 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:07:58.012711 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:58.012711 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 284/573] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:58.012711 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fc91e-079e-4cf0-999b-d58587debbb8 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-ee0101c5-21b1-4f16-adfc-7a44a2166a22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:07:58.020842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:58.022312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:58.023286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:07:58.023286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:07:58.023286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:07:58.023286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:07:58.023286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:07:58.023286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:07:58.023286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:58.023286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:07:58.023286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 290/574] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:58.024027 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0101c5-21b1-4f16-adfc-7a44a2166a22 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:58.106329 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:58.124619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fc91e-079e-4cf0-999b-d58587debbb8 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:58.134707 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0101c5-21b1-4f16-adfc-7a44a2166a22 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:58.161050 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc228d-d4a5-4576-b62e-1fed938e26cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:58.161679 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc228d-d4a5-4576-b62e-1fed938e26cd None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.161960 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc228d-d4a5-4576-b62e-1fed938e26cd None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.162938 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc228d-d4a5-4576-b62e-1fed938e26cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.170007 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc228d-d4a5-4576-b62e-1fed938e26cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:58.171452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dc228d-d4a5-4576-b62e-1fed938e26cd None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.175896 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00771a-42db-4ae9-bc9b-45bd5b5bfbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:58.176512 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00771a-42db-4ae9-bc9b-45bd5b5bfbcc None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.176794 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00771a-42db-4ae9-bc9b-45bd5b5bfbcc None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.177071 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00771a-42db-4ae9-bc9b-45bd5b5bfbcc None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.177712 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00771a-42db-4ae9-bc9b-45bd5b5bfbcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:58.178737 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00771a-42db-4ae9-bc9b-45bd5b5bfbcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:58.180207 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd00771a-42db-4ae9-bc9b-45bd5b5bfbcc None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-d2dc228d-d4a5-4576-b62e-1fed938e26cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:07:58.184336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:58.185251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:58.191505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:07:58.191505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:07:58.191505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:07:58.191505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:07:58.191505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:07:58.191505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:07:58.191505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:58.191505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:58.191505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 285/575] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:58.191505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc228d-d4a5-4576-b62e-1fed938e26cd None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:58.199206 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 291/576] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:58.199936 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00771a-42db-4ae9-bc9b-45bd5b5bfbcc None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:58.251198 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:58.313347 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc228d-d4a5-4576-b62e-1fed938e26cd None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:58.320107 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd00771a-42db-4ae9-bc9b-45bd5b5bfbcc None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:58.352557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee5a38-1ec9-4183-97a7-ec0dd08121e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:58.353167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee5a38-1ec9-4183-97a7-ec0dd08121e7 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.353459 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee5a38-1ec9-4183-97a7-ec0dd08121e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.353737 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee5a38-1ec9-4183-97a7-ec0dd08121e7 None admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.354435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee5a38-1ec9-4183-97a7-ec0dd08121e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:58.354763 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee5a38-1ec9-4183-97a7-ec0dd08121e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:58.356234 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee5a38-1ec9-4183-97a7-ec0dd08121e7 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.359744 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa9e6e-3e4b-466a-90cb-1937e2908388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:58.360355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa9e6e-3e4b-466a-90cb-1937e2908388 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.360631 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa9e6e-3e4b-466a-90cb-1937e2908388 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.360898 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa9e6e-3e4b-466a-90cb-1937e2908388 None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.361577 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa9e6e-3e4b-466a-90cb-1937e2908388 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:58.361881 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa9e6e-3e4b-466a-90cb-1937e2908388 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:58.363296 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa9e6e-3e4b-466a-90cb-1937e2908388 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.365017 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:58.374529 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 286/577] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:58.374529 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee5a38-1ec9-4183-97a7-ec0dd08121e7 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:58.376729 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 292/578] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:58.380419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa9e6e-3e4b-466a-90cb-1937e2908388 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:58.485006 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa9e6e-3e4b-466a-90cb-1937e2908388 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:58.491954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee5a38-1ec9-4183-97a7-ec0dd08121e7 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:58.500396 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:58.523665 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cecb5a-d244-4937-9c1c-b7a4c0083bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:58.524321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cecb5a-d244-4937-9c1c-b7a4c0083bf7 None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.524603 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cecb5a-d244-4937-9c1c-b7a4c0083bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.524877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cecb5a-d244-4937-9c1c-b7a4c0083bf7 None admin] PATH_INFO: `/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/18eb03a1a720431a9c78883a0aab8741/roles/3db17b52a09844b88bc370419f6c6265` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.530803 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a827b3-b98b-4d65-8975-80db5caff04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:58.531423 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a827b3-b98b-4d65-8975-80db5caff04a None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.531702 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a827b3-b98b-4d65-8975-80db5caff04a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.532007 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a827b3-b98b-4d65-8975-80db5caff04a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.539725 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a827b3-b98b-4d65-8975-80db5caff04a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:58.540910 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cecb5a-d244-4937-9c1c-b7a4c0083bf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d86eb186aa94e1bb4a358cfc19447b1, user_id=18eb03a1a720431a9c78883a0aab8741, role_id=3db17b52a09844b88bc370419f6c6265)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:58.541195 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a827b3-b98b-4d65-8975-80db5caff04a None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.542558 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cecb5a-d244-4937-9c1c-b7a4c0083bf7 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-e6a827b3-b98b-4d65-8975-80db5caff04a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:07:58.552565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:07:58.554628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:07:58.555933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:07:58.555933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:07:58.555933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:07:58.555933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:07:58.555933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:07:58.555933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:07:58.555933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:07:58.555933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:07:58.559119 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 287/579] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:07:58.559890 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a827b3-b98b-4d65-8975-80db5caff04a None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:58.572013 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 293/580] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:58 2022] PUT /identity/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/18eb03a1a720431a9c78883a0aab8741/roles/3db17b52a09844b88bc370419f6c6265 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:58.572013 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cecb5a-d244-4937-9c1c-b7a4c0083bf7 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:58.641077 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:58.696659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a827b3-b98b-4d65-8975-80db5caff04a None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:58.712334 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cecb5a-d244-4937-9c1c-b7a4c0083bf7 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:58.748002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bf53e-82cd-43c6-a10e-6bdf69aa64b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:58.748995 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bf53e-82cd-43c6-a10e-6bdf69aa64b7 None admin] REQUEST_METHOD: `PUT` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.749405 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bf53e-82cd-43c6-a10e-6bdf69aa64b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.750219 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bf53e-82cd-43c6-a10e-6bdf69aa64b7 None admin] PATH_INFO: `/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/60819c30ec7c42d1a1891e7ce07f8473/roles/3db17b52a09844b88bc370419f6c6265` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.757502 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e28e7c-924f-44d8-b3b0-1b92092b5ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:58.758152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e28e7c-924f-44d8-b3b0-1b92092b5ed0 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.758431 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e28e7c-924f-44d8-b3b0-1b92092b5ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.758706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e28e7c-924f-44d8-b3b0-1b92092b5ed0 None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.759406 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e28e7c-924f-44d8-b3b0-1b92092b5ed0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:07:58.759686 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e28e7c-924f-44d8-b3b0-1b92092b5ed0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:58.763365 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e28e7c-924f-44d8-b3b0-1b92092b5ed0 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.771404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bf53e-82cd-43c6-a10e-6bdf69aa64b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d86eb186aa94e1bb4a358cfc19447b1, user_id=60819c30ec7c42d1a1891e7ce07f8473, role_id=3db17b52a09844b88bc370419f6c6265)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:58.773985 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bf53e-82cd-43c6-a10e-6bdf69aa64b7 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.775478 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 294/581] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:07:58.781056 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e28e7c-924f-44d8-b3b0-1b92092b5ed0 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:58.798319 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 288/582] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:58 2022] PUT /identity/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/60819c30ec7c42d1a1891e7ce07f8473/roles/3db17b52a09844b88bc370419f6c6265 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:07:58.910170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e28e7c-924f-44d8-b3b0-1b92092b5ed0 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:07:58.913343 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:58.952178 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4559b-2438-401a-86d2-fa19448eb24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:07:58.953148 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4559b-2438-401a-86d2-fa19448eb24a None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:58.953572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4559b-2438-401a-86d2-fa19448eb24a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:58.954022 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4559b-2438-401a-86d2-fa19448eb24a None admin] PATH_INFO: `/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/b57524e5da8647a1a258f8c1e4258b62/roles/3db17b52a09844b88bc370419f6c6265` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:58.972156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4559b-2438-401a-86d2-fa19448eb24a None admin] RBAC: Authorizing `identity:create_grant(project_id=0d86eb186aa94e1bb4a358cfc19447b1, user_id=b57524e5da8647a1a258f8c1e4258b62, role_id=3db17b52a09844b88bc370419f6c6265)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:07:58.975193 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4559b-2438-401a-86d2-fa19448eb24a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:07:58.992954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 295/583] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:07:58 2022] PUT /identity/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/b57524e5da8647a1a258f8c1e4258b62/roles/3db17b52a09844b88bc370419f6c6265 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:07:59.416370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac310e79-19e5-4c83-83b5-06564b147b7c None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:59.416880 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac310e79-19e5-4c83-83b5-06564b147b7c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:59.416956 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac310e79-19e5-4c83-83b5-06564b147b7c None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:59.418377 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 289/584] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:07:59.423816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681f915-d722-482f-afa8-a5d66dcfff14 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:07:59.424660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681f915-d722-482f-afa8-a5d66dcfff14 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:07:59.425137 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681f915-d722-482f-afa8-a5d66dcfff14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:07:59.445078 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-6681f915-d722-482f-afa8-a5d66dcfff14 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:07:59.446660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-6681f915-d722-482f-afa8-a5d66dcfff14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:07:59.523377 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 296/585] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:07:59.856160 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac310e79-19e5-4c83-83b5-06564b147b7c None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:07:59.875575 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:07:59.968142 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac310e79-19e5-4c83-83b5-06564b147b7c None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:00.011658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72c7f8-8d52-4113-a83c-b1cd62511638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:00.012342 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72c7f8-8d52-4113-a83c-b1cd62511638 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.012629 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72c7f8-8d52-4113-a83c-b1cd62511638 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.012896 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72c7f8-8d52-4113-a83c-b1cd62511638 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.025628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72c7f8-8d52-4113-a83c-b1cd62511638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-8d72c7f8-8d52-4113-a83c-b1cd62511638 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:00.030521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:00.031456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:00.032324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 290/586] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:07:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:00.039479 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681f915-d722-482f-afa8-a5d66dcfff14 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:00.132690 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:00.150478 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681f915-d722-482f-afa8-a5d66dcfff14 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:00.189967 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca808807-0520-4eb2-b92a-e855f14f6496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:00.190578 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca808807-0520-4eb2-b92a-e855f14f6496 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.190857 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca808807-0520-4eb2-b92a-e855f14f6496 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.191133 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca808807-0520-4eb2-b92a-e855f14f6496 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.191879 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca808807-0520-4eb2-b92a-e855f14f6496 None admin] RBAC: Adding query filter params (name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:00.192191 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca808807-0520-4eb2-b92a-e855f14f6496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:00.194331 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca808807-0520-4eb2-b92a-e855f14f6496 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:00.204123 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 297/587] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:00.212738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72c7f8-8d52-4113-a83c-b1cd62511638 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:00.300861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:00.321109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72c7f8-8d52-4113-a83c-b1cd62511638 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:00.360273 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb6c71-727e-46fe-9f31-503c24839b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:00.360897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb6c71-727e-46fe-9f31-503c24839b11 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.361171 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb6c71-727e-46fe-9f31-503c24839b11 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.361440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb6c71-727e-46fe-9f31-503c24839b11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.372291 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb6c71-727e-46fe-9f31-503c24839b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:00.373752 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb6c71-727e-46fe-9f31-503c24839b11 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-08cb6c71-727e-46fe-9f31-503c24839b11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:00.389115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:00.390067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:00.390961 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:00.390961 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:00.390961 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:00.390961 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 291/588] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:00.396122 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca808807-0520-4eb2-b92a-e855f14f6496 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:00.507498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca808807-0520-4eb2-b92a-e855f14f6496 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:00.542593 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a683ee-0174-4ee1-8d35-19200c1f358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:00.543201 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a683ee-0174-4ee1-8d35-19200c1f358a None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.543476 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a683ee-0174-4ee1-8d35-19200c1f358a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.543746 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a683ee-0174-4ee1-8d35-19200c1f358a None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.544420 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a683ee-0174-4ee1-8d35-19200c1f358a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:00.544719 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a683ee-0174-4ee1-8d35-19200c1f358a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:00.546082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a683ee-0174-4ee1-8d35-19200c1f358a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:00.559452 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 298/589] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:00.564915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb6c71-727e-46fe-9f31-503c24839b11 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:00.673714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb6c71-727e-46fe-9f31-503c24839b11 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:00.706310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:00.710483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be77ab9-29e9-4a98-a6fc-a488e17c23cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:00.710946 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be77ab9-29e9-4a98-a6fc-a488e17c23cc None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.711228 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be77ab9-29e9-4a98-a6fc-a488e17c23cc None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.711500 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be77ab9-29e9-4a98-a6fc-a488e17c23cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.719627 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be77ab9-29e9-4a98-a6fc-a488e17c23cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:00.721481 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be77ab9-29e9-4a98-a6fc-a488e17c23cc None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-1be77ab9-29e9-4a98-a6fc-a488e17c23cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:00.733295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:00.734281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:00.735236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:00.735236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:00.735236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:00.735236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:00.735236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:00.735236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:00.735236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:00.735236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:00.735236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:00.735236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:00.735236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 292/590] 10.222.0.58 () {56 vars in 1093 bytes} [Tue Aug 23 22:08:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:00.741142 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a683ee-0174-4ee1-8d35-19200c1f358a None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:00.750928 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:00.855375 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a683ee-0174-4ee1-8d35-19200c1f358a None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:00.891178 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92641ad-60ca-4b5f-96d4-7911fcaeb7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:00.891793 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92641ad-60ca-4b5f-96d4-7911fcaeb7ff None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.892101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92641ad-60ca-4b5f-96d4-7911fcaeb7ff None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.892376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92641ad-60ca-4b5f-96d4-7911fcaeb7ff None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.893105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92641ad-60ca-4b5f-96d4-7911fcaeb7ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:00.893414 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92641ad-60ca-4b5f-96d4-7911fcaeb7ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:00.894851 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92641ad-60ca-4b5f-96d4-7911fcaeb7ff None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:00.914452 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 299/591] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Aug 23 22:08:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:00.920167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be77ab9-29e9-4a98-a6fc-a488e17c23cc None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:00.975582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c1d9e-0784-4a06-a506-5a7fe8305a55 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.975951 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c1d9e-0784-4a06-a506-5a7fe8305a55 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.976171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c1d9e-0784-4a06-a506-5a7fe8305a55 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:00.977754 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 300/592] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:00.982958 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a1b5-ba76-40e7-a31e-ab3e95a6cb4b None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:00.983249 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a1b5-ba76-40e7-a31e-ab3e95a6cb4b None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:00.983520 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a1b5-ba76-40e7-a31e-ab3e95a6cb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.005601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-4160a1b5-ba76-40e7-a31e-ab3e95a6cb4b None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:01.006895 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-4160a1b5-ba76-40e7-a31e-ab3e95a6cb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:01.036783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be77ab9-29e9-4a98-a6fc-a488e17c23cc None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:01.075339 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:01.085144 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b927d14-543a-419c-9180-3452760a50e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:01.085752 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b927d14-543a-419c-9180-3452760a50e5 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.086030 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b927d14-543a-419c-9180-3452760a50e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.086300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b927d14-543a-419c-9180-3452760a50e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.089515 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 301/593] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:08:01.152330 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:01.158949 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b927d14-543a-419c-9180-3452760a50e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:01.162795 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b927d14-543a-419c-9180-3452760a50e5 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:01.197916 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59a89e-3416-4c58-8c3a-6df851566d7a None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.198220 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59a89e-3416-4c58-8c3a-6df851566d7a None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.198472 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59a89e-3416-4c58-8c3a-6df851566d7a None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.200154 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 302/594] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:01.205666 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587334e-430c-456b-ba09-9e20110b5a81 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.206062 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587334e-430c-456b-ba09-9e20110b5a81 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.206487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587334e-430c-456b-ba09-9e20110b5a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.231335 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-c587334e-430c-456b-ba09-9e20110b5a81 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:01.232722 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-c587334e-430c-456b-ba09-9e20110b5a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:01.291310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 293/595] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:01.296732 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b927d14-543a-419c-9180-3452760a50e5 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:01.318142 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 303/596] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:01.395036 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:01.407446 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b927d14-543a-419c-9180-3452760a50e5 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:01.432794 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451d24b-1012-4f2f-b56c-4b3255ddca9a None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.433551 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451d24b-1012-4f2f-b56c-4b3255ddca9a None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.433927 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451d24b-1012-4f2f-b56c-4b3255ddca9a None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.435602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 304/597] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:01.440743 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48cc12-4a0c-4567-98a2-36c119e1f3a6 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.441121 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48cc12-4a0c-4567-98a2-36c119e1f3a6 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.441498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48cc12-4a0c-4567-98a2-36c119e1f3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.442869 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbb5dc-b925-47f7-90d2-c131034ff5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:01.444440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbb5dc-b925-47f7-90d2-c131034ff5df None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.444882 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbb5dc-b925-47f7-90d2-c131034ff5df None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.445402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbb5dc-b925-47f7-90d2-c131034ff5df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.455849 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbb5dc-b925-47f7-90d2-c131034ff5df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:01.457495 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbb5dc-b925-47f7-90d2-c131034ff5df None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:01.462401 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-8e48cc12-4a0c-4567-98a2-36c119e1f3a6 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:01.463593 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-8e48cc12-4a0c-4567-98a2-36c119e1f3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-a8dbb5dc-b925-47f7-90d2-c131034ff5df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:01.473626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:01.474620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:01.476384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:01.476384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:01.476384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:01.476384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 294/598] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:01.476384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbb5dc-b925-47f7-90d2-c131034ff5df None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:01.544209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 305/599] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:08:01.545751 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48cc12-4a0c-4567-98a2-36c119e1f3a6 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:01.605568 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:01.606134 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbb5dc-b925-47f7-90d2-c131034ff5df None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:01.651949 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edef654-7693-4113-a460-cbd007f3ed7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:01.652583 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edef654-7693-4113-a460-cbd007f3ed7d None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.653008 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edef654-7693-4113-a460-cbd007f3ed7d None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.653577 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edef654-7693-4113-a460-cbd007f3ed7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.659597 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48cc12-4a0c-4567-98a2-36c119e1f3a6 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:01.663286 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:01.667467 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edef654-7693-4113-a460-cbd007f3ed7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-1edef654-7693-4113-a460-cbd007f3ed7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:01.672411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:01.673541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:01.674595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:01.674595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:01.674595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:01.674595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:01.674595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:01.674595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:01.674595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:01.674595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:01.674595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:01.674595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:01.674595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:01.674595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:01.677007 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 295/600] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:01.678327 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edef654-7693-4113-a460-cbd007f3ed7d None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:01.708037 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee892e6a-9116-4d1a-94d3-efc5ffb59d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:01.709623 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee892e6a-9116-4d1a-94d3-efc5ffb59d48 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.710719 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee892e6a-9116-4d1a-94d3-efc5ffb59d48 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.711483 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee892e6a-9116-4d1a-94d3-efc5ffb59d48 None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.712908 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee892e6a-9116-4d1a-94d3-efc5ffb59d48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:01.713709 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee892e6a-9116-4d1a-94d3-efc5ffb59d48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:01.715913 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee892e6a-9116-4d1a-94d3-efc5ffb59d48 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:01.728844 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 306/601] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:01.729640 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee892e6a-9116-4d1a-94d3-efc5ffb59d48 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:01.798708 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edef654-7693-4113-a460-cbd007f3ed7d None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:01.834708 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60357d02-7c1c-46fd-8982-948e6baee6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:01.835340 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60357d02-7c1c-46fd-8982-948e6baee6e6 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.835624 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60357d02-7c1c-46fd-8982-948e6baee6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.835937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60357d02-7c1c-46fd-8982-948e6baee6e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.842781 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee892e6a-9116-4d1a-94d3-efc5ffb59d48 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:01.846799 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60357d02-7c1c-46fd-8982-948e6baee6e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-60357d02-7c1c-46fd-8982-948e6baee6e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:01.852674 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:01.853618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:01.854509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:01.854509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:01.854509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:01.854509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:01.854509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:01.854509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:01.854509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:01.854509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:01.854509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:01.854509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:01.854509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:01.854509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:01.858675 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 296/602] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:01.859511 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60357d02-7c1c-46fd-8982-948e6baee6e6 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:01.859645 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:01.882909 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee91cca-e5bc-41b8-b9ac-dc3119ef2faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:01.883507 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee91cca-e5bc-41b8-b9ac-dc3119ef2faa None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.883781 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee91cca-e5bc-41b8-b9ac-dc3119ef2faa None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.884084 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee91cca-e5bc-41b8-b9ac-dc3119ef2faa None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:01.884736 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee91cca-e5bc-41b8-b9ac-dc3119ef2faa None admin] RBAC: Adding query filter params (name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:01.885033 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee91cca-e5bc-41b8-b9ac-dc3119ef2faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:01.886401 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee91cca-e5bc-41b8-b9ac-dc3119ef2faa None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:01.894265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 307/603] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:01.895026 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee91cca-e5bc-41b8-b9ac-dc3119ef2faa None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:01.920695 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:01.964190 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60357d02-7c1c-46fd-8982-948e6baee6e6 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:01.995165 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee91cca-e5bc-41b8-b9ac-dc3119ef2faa None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:01.998598 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bdfa9-0976-43c0-8861-bd796eb6a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:01.999214 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bdfa9-0976-43c0-8861-bd796eb6a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:01.999495 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bdfa9-0976-43c0-8861-bd796eb6a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:01.999766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bdfa9-0976-43c0-8861-bd796eb6a6a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:02.006824 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bdfa9-0976-43c0-8861-bd796eb6a6a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:02.008308 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5bdfa9-0976-43c0-8861-bd796eb6a6a3 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-8c5bdfa9-0976-43c0-8861-bd796eb6a6a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:02.019117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:02.020139 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:02.021371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:02.021371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:02.021371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:02.021371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:02.021371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:02.021371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:02.021371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:02.021371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:02.021371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 297/604] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:02.021371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bdfa9-0976-43c0-8861-bd796eb6a6a3 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:02.033664 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab457edc-35fb-43d7-8505-146466e53395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:02.034580 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab457edc-35fb-43d7-8505-146466e53395 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:02.034865 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab457edc-35fb-43d7-8505-146466e53395 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:02.035141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab457edc-35fb-43d7-8505-146466e53395 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:02.035797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab457edc-35fb-43d7-8505-146466e53395 None admin] RBAC: Adding query filter params (name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:02.036129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab457edc-35fb-43d7-8505-146466e53395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:02.037564 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab457edc-35fb-43d7-8505-146466e53395 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:02.045621 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 308/605] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:02.046504 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab457edc-35fb-43d7-8505-146466e53395 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:02.086511 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:02.122894 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5bdfa9-0976-43c0-8861-bd796eb6a6a3 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:02.142658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:02.147806 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab457edc-35fb-43d7-8505-146466e53395 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:02.157810 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10276f-400f-4405-91cf-3a31e5ffb75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:02.158437 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10276f-400f-4405-91cf-3a31e5ffb75c None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:02.158718 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10276f-400f-4405-91cf-3a31e5ffb75c None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:02.158995 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10276f-400f-4405-91cf-3a31e5ffb75c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:02.169714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10276f-400f-4405-91cf-3a31e5ffb75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-ca10276f-400f-4405-91cf-3a31e5ffb75c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:02.174769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:02.175721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 298/606] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:02.176975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10276f-400f-4405-91cf-3a31e5ffb75c None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:02.185757 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de36f4-ee45-4aed-a0f1-ff4016f52d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:02.186402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de36f4-ee45-4aed-a0f1-ff4016f52d0f None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:02.186670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de36f4-ee45-4aed-a0f1-ff4016f52d0f None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:02.186945 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de36f4-ee45-4aed-a0f1-ff4016f52d0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:02.197102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de36f4-ee45-4aed-a0f1-ff4016f52d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:02.198543 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de36f4-ee45-4aed-a0f1-ff4016f52d0f None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-92de36f4-ee45-4aed-a0f1-ff4016f52d0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:02.212901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:02.214173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:02.215398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:02.215398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:02.215398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:02.215398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 309/607] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:02.215398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de36f4-ee45-4aed-a0f1-ff4016f52d0f None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:02.284576 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10276f-400f-4405-91cf-3a31e5ffb75c None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:02.313101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:02.319542 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18359b-4923-4b23-a829-a91c20f697d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:02.320260 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18359b-4923-4b23-a829-a91c20f697d9 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:02.320540 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18359b-4923-4b23-a829-a91c20f697d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:02.320870 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18359b-4923-4b23-a829-a91c20f697d9 None admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:02.321558 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18359b-4923-4b23-a829-a91c20f697d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:02.321886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18359b-4923-4b23-a829-a91c20f697d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:02.323320 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18359b-4923-4b23-a829-a91c20f697d9 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:02.323509 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de36f4-ee45-4aed-a0f1-ff4016f52d0f None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:02.336377 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 299/608] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:02.337226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18359b-4923-4b23-a829-a91c20f697d9 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:02.358747 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312b9cf-e38d-4f56-b4dd-eb56731ce67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:02.359498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312b9cf-e38d-4f56-b4dd-eb56731ce67e None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:02.359776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312b9cf-e38d-4f56-b4dd-eb56731ce67e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:02.360083 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312b9cf-e38d-4f56-b4dd-eb56731ce67e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:02.371008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312b9cf-e38d-4f56-b4dd-eb56731ce67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:02.372484 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312b9cf-e38d-4f56-b4dd-eb56731ce67e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:02.379822 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-2312b9cf-e38d-4f56-b4dd-eb56731ce67e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:02.387330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:02.388501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:02.389581 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:02.389581 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:02.389581 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:02.392112 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 310/609] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:02.393452 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312b9cf-e38d-4f56-b4dd-eb56731ce67e None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:02.440343 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18359b-4923-4b23-a829-a91c20f697d9 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:02.476694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de029a0d-3977-483d-8e1c-72131f3ce214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:02.477300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de029a0d-3977-483d-8e1c-72131f3ce214 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:02.477578 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de029a0d-3977-483d-8e1c-72131f3ce214 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:02.478126 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de029a0d-3977-483d-8e1c-72131f3ce214 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:02.478499 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de029a0d-3977-483d-8e1c-72131f3ce214 None admin] RBAC: Adding query filter params (name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:02.478930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de029a0d-3977-483d-8e1c-72131f3ce214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:02.480200 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de029a0d-3977-483d-8e1c-72131f3ce214 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:02.488089 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 300/610] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:08:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:02.488858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de029a0d-3977-483d-8e1c-72131f3ce214 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:02.501443 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312b9cf-e38d-4f56-b4dd-eb56731ce67e None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:02.534986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10debb-16b3-44d1-bdb5-8927cc2cc057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:02.535585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10debb-16b3-44d1-bdb5-8927cc2cc057 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:02.535897 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10debb-16b3-44d1-bdb5-8927cc2cc057 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:02.536173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10debb-16b3-44d1-bdb5-8927cc2cc057 None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:02.536807 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10debb-16b3-44d1-bdb5-8927cc2cc057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:02.537738 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10debb-16b3-44d1-bdb5-8927cc2cc057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:02.539099 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10debb-16b3-44d1-bdb5-8927cc2cc057 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:02.551326 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 311/611] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:02.552146 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10debb-16b3-44d1-bdb5-8927cc2cc057 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:02.554682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:02.592791 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de029a0d-3977-483d-8e1c-72131f3ce214 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:02.594852 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:02.628947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b47ff-ed7f-41d5-b2dd-e50052fb5a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:02.629599 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b47ff-ed7f-41d5-b2dd-e50052fb5a25 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:02.629815 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b47ff-ed7f-41d5-b2dd-e50052fb5a25 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:02.630085 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b47ff-ed7f-41d5-b2dd-e50052fb5a25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:02.631481 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b47ff-ed7f-41d5-b2dd-e50052fb5a25 None admin] RBAC: Adding query filter params (role.id=3db17b52a09844b88bc370419f6c6265, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=d43a6040fd95466fa17acdb1f30476ab) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:02.631795 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b47ff-ed7f-41d5-b2dd-e50052fb5a25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:02.633312 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b47ff-ed7f-41d5-b2dd-e50052fb5a25 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:02.650698 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 301/612] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:02 2022] GET /identity/v3/role_assignments?user.id=d43a6040fd95466fa17acdb1f30476ab&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=3db17b52a09844b88bc370419f6c6265 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:02.650698 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b47ff-ed7f-41d5-b2dd-e50052fb5a25 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:02.670557 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10debb-16b3-44d1-bdb5-8927cc2cc057 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:02.713140 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688b16b-c668-48fe-83f2-69b31d7633ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:02.713940 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688b16b-c668-48fe-83f2-69b31d7633ca None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:02.714339 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688b16b-c668-48fe-83f2-69b31d7633ca None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:02.714709 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688b16b-c668-48fe-83f2-69b31d7633ca None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:02.715465 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688b16b-c668-48fe-83f2-69b31d7633ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:02.715902 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688b16b-c668-48fe-83f2-69b31d7633ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:02.717428 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688b16b-c668-48fe-83f2-69b31d7633ca None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:02.731060 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 312/613] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:02.732122 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688b16b-c668-48fe-83f2-69b31d7633ca None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:02.767985 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b47ff-ed7f-41d5-b2dd-e50052fb5a25 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:02.805829 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:02.808896 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92f443-acd9-4ccc-b61a-66e1befa8422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:02.809546 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92f443-acd9-4ccc-b61a-66e1befa8422 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:02.809830 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92f443-acd9-4ccc-b61a-66e1befa8422 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:02.810109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92f443-acd9-4ccc-b61a-66e1befa8422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:02.822692 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92f443-acd9-4ccc-b61a-66e1befa8422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:02.824212 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92f443-acd9-4ccc-b61a-66e1befa8422 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-ef92f443-acd9-4ccc-b61a-66e1befa8422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:02.841560 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:02.842537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:02.844426 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:02.844426 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:02.844426 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:02.844426 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 302/614] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:02.844426 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92f443-acd9-4ccc-b61a-66e1befa8422 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:02.855758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688b16b-c668-48fe-83f2-69b31d7633ca None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:02.867457 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:02.895725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a8f20-cade-483d-88d1-bc165397263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:02.897329 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a8f20-cade-483d-88d1-bc165397263a None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:02.897929 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a8f20-cade-483d-88d1-bc165397263a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:02.898373 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a8f20-cade-483d-88d1-bc165397263a None admin] PATH_INFO: `/v3/users/glance` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:02.907705 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a8f20-cade-483d-88d1-bc165397263a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:02.909411 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a8f20-cade-483d-88d1-bc165397263a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-eb9a8f20-cade-483d-88d1-bc165397263a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:02.922528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:02.923706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:02.924894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:02.924894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:02.924894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:02.924894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:02.924894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:02.924894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:02.924894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:02.924894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:02.924894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 22:08:02.924894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:02.924894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 313/615] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:02.924894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a8f20-cade-483d-88d1-bc165397263a None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:02.971326 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92f443-acd9-4ccc-b61a-66e1befa8422 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:03.007966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3d933-bf5c-4401-b20b-27d620d0862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:03.008778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3d933-bf5c-4401-b20b-27d620d0862a None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.009338 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3d933-bf5c-4401-b20b-27d620d0862a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.009681 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3d933-bf5c-4401-b20b-27d620d0862a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.019115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3d933-bf5c-4401-b20b-27d620d0862a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:03.020695 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3d933-bf5c-4401-b20b-27d620d0862a None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:03.033740 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a8f20-cade-483d-88d1-bc165397263a None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-60c3d933-bf5c-4401-b20b-27d620d0862a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:03.036006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:03.037166 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:03.038310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:03.038310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:03.038310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:03.038310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:03.038310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:03.038310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:03.038310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:03.038310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:03.038310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:08:03.038310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:03.038953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 303/616] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:03.039194 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3d933-bf5c-4401-b20b-27d620d0862a None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:03.061200 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:03.076567 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df963cc0-af38-421b-8e83-2ca7f2029fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:03.077167 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df963cc0-af38-421b-8e83-2ca7f2029fc9 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.077450 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df963cc0-af38-421b-8e83-2ca7f2029fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.077722 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df963cc0-af38-421b-8e83-2ca7f2029fc9 None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.078365 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df963cc0-af38-421b-8e83-2ca7f2029fc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:03.078667 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df963cc0-af38-421b-8e83-2ca7f2029fc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:03.080064 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df963cc0-af38-421b-8e83-2ca7f2029fc9 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:03.097474 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 314/617] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:03.097474 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df963cc0-af38-421b-8e83-2ca7f2029fc9 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:03.131803 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:03.160720 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3d933-bf5c-4401-b20b-27d620d0862a None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:03.202440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2efb8-278a-4d2d-a08c-55c5d03d265f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:03.203052 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2efb8-278a-4d2d-a08c-55c5d03d265f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.203340 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2efb8-278a-4d2d-a08c-55c5d03d265f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.203612 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2efb8-278a-4d2d-a08c-55c5d03d265f None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.204379 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2efb8-278a-4d2d-a08c-55c5d03d265f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:03.204689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2efb8-278a-4d2d-a08c-55c5d03d265f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:03.206121 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2efb8-278a-4d2d-a08c-55c5d03d265f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:03.206806 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df963cc0-af38-421b-8e83-2ca7f2029fc9 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:03.227719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 304/618] 10.222.0.58 () {56 vars in 1137 bytes} [Tue Aug 23 22:08:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:03.228621 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2efb8-278a-4d2d-a08c-55c5d03d265f None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:03.265345 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082223f-1b43-461f-b046-7f6eedb22cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:03.265959 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082223f-1b43-461f-b046-7f6eedb22cea None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.266240 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082223f-1b43-461f-b046-7f6eedb22cea None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.266511 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082223f-1b43-461f-b046-7f6eedb22cea None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.267240 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082223f-1b43-461f-b046-7f6eedb22cea None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:03.267563 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082223f-1b43-461f-b046-7f6eedb22cea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:03.269033 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082223f-1b43-461f-b046-7f6eedb22cea None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:03.292720 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 315/619] 10.222.0.58 () {56 vars in 1137 bytes} [Tue Aug 23 22:08:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:03.292720 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082223f-1b43-461f-b046-7f6eedb22cea None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:03.336188 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:03.350743 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2efb8-278a-4d2d-a08c-55c5d03d265f None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:03.388636 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e892a-c4ca-4352-849c-fcd7f1bd4d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:03.389380 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e892a-c4ca-4352-849c-fcd7f1bd4d43 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.389661 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e892a-c4ca-4352-849c-fcd7f1bd4d43 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.389954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e892a-c4ca-4352-849c-fcd7f1bd4d43 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.393648 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:03.399504 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082223f-1b43-461f-b046-7f6eedb22cea None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:03.400156 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e892a-c4ca-4352-849c-fcd7f1bd4d43 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:03.403400 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e892a-c4ca-4352-849c-fcd7f1bd4d43 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-b74e892a-c4ca-4352-849c-fcd7f1bd4d43 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:03.419017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:03.420108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:03.421184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:03.421184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:03.421184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:03.421184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:03.421184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:03.421184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:03.421184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:03.421184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:03.421184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 22:08:03.421184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:03.424950 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 305/620] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:08:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:03.425419 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e892a-c4ca-4352-849c-fcd7f1bd4d43 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:03.436915 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4325fd-dcf5-4965-93f5-b94e2e4aadac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:03.437598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4325fd-dcf5-4965-93f5-b94e2e4aadac None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.437884 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4325fd-dcf5-4965-93f5-b94e2e4aadac None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.438158 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4325fd-dcf5-4965-93f5-b94e2e4aadac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.517531 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4325fd-dcf5-4965-93f5-b94e2e4aadac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:03.519010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4325fd-dcf5-4965-93f5-b94e2e4aadac None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:03.534883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e892a-c4ca-4352-849c-fcd7f1bd4d43 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:03.562323 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:03.571630 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932fe55-5982-4661-acc3-494365ec9f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:03.572262 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fe55-5982-4661-acc3-494365ec9f8c None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.572681 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fe55-5982-4661-acc3-494365ec9f8c None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.572854 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fe55-5982-4661-acc3-494365ec9f8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.627726 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 316/621] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:03.628353 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4325fd-dcf5-4965-93f5-b94e2e4aadac None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:03.643947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:03.652787 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932fe55-5982-4661-acc3-494365ec9f8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:03.654254 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932fe55-5982-4661-acc3-494365ec9f8c None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:03.738743 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4325fd-dcf5-4965-93f5-b94e2e4aadac None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:03.762007 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 306/622] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:03.762857 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932fe55-5982-4661-acc3-494365ec9f8c None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:03.781213 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9053d4-3a5b-4ecb-a328-d866c252b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:03.781926 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9053d4-3a5b-4ecb-a328-d866c252b587 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.782205 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9053d4-3a5b-4ecb-a328-d866c252b587 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.782478 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9053d4-3a5b-4ecb-a328-d866c252b587 None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.783201 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9053d4-3a5b-4ecb-a328-d866c252b587 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:03.783507 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9053d4-3a5b-4ecb-a328-d866c252b587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:03.785100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9053d4-3a5b-4ecb-a328-d866c252b587 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:03.795431 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:03.806305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 317/623] 10.222.0.58 () {56 vars in 1139 bytes} [Tue Aug 23 22:08:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:03.807481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9053d4-3a5b-4ecb-a328-d866c252b587 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:03.868962 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:03.876226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932fe55-5982-4661-acc3-494365ec9f8c None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:03.914135 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92941e1a-3759-4212-886d-f820b95fabbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:03.915032 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92941e1a-3759-4212-886d-f820b95fabbe None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.915488 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92941e1a-3759-4212-886d-f820b95fabbe None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.915963 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92941e1a-3759-4212-886d-f820b95fabbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.917602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9053d4-3a5b-4ecb-a328-d866c252b587 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:03.926696 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92941e1a-3759-4212-886d-f820b95fabbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:03.929264 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92941e1a-3759-4212-886d-f820b95fabbe None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-92941e1a-3759-4212-886d-f820b95fabbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:03.945471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:03.946440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:03.952442 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:03.952442 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:03.952442 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:03.952442 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 307/624] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:03.952442 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92941e1a-3759-4212-886d-f820b95fabbe None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:03.960786 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351ebdb-199c-467d-aa73-03d24c579def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:03.961834 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351ebdb-199c-467d-aa73-03d24c579def None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:03.962116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351ebdb-199c-467d-aa73-03d24c579def None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:03.962386 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351ebdb-199c-467d-aa73-03d24c579def None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:03.973698 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351ebdb-199c-467d-aa73-03d24c579def None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:03.975267 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351ebdb-199c-467d-aa73-03d24c579def None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-c351ebdb-199c-467d-aa73-03d24c579def None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:03.989960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:03.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:03.992632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:03.992632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:03.992632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:03.996646 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 318/625] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:03.997338 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351ebdb-199c-467d-aa73-03d24c579def None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.056902 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:04.067772 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92941e1a-3759-4212-886d-f820b95fabbe None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.104235 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9d356-c251-47da-b311-462fa9ada889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.104831 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9d356-c251-47da-b311-462fa9ada889 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.105925 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9d356-c251-47da-b311-462fa9ada889 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.106202 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9d356-c251-47da-b311-462fa9ada889 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.116192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351ebdb-199c-467d-aa73-03d24c579def None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.125108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:04.155493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db642768-719b-4d18-af66-5e503e3fe0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.156236 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db642768-719b-4d18-af66-5e503e3fe0fa None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.156518 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db642768-719b-4d18-af66-5e503e3fe0fa None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.156918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db642768-719b-4d18-af66-5e503e3fe0fa None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.157563 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db642768-719b-4d18-af66-5e503e3fe0fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:04.157866 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db642768-719b-4d18-af66-5e503e3fe0fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:04.159235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db642768-719b-4d18-af66-5e503e3fe0fa None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:04.175502 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9d356-c251-47da-b311-462fa9ada889 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:04.176666 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 319/626] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:04.176937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9d356-c251-47da-b311-462fa9ada889 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:04.177421 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db642768-719b-4d18-af66-5e503e3fe0fa None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.287295 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db642768-719b-4d18-af66-5e503e3fe0fa None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.298293 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:04.307195 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 308/627] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 22:08:04.307195 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9d356-c251-47da-b311-462fa9ada889 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.330522 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32397a77-c4ea-4613-b854-ae5888f00e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.331364 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32397a77-c4ea-4613-b854-ae5888f00e64 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.331655 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32397a77-c4ea-4613-b854-ae5888f00e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.331974 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32397a77-c4ea-4613-b854-ae5888f00e64 None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.332625 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32397a77-c4ea-4613-b854-ae5888f00e64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:04.332993 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32397a77-c4ea-4613-b854-ae5888f00e64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:04.335166 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32397a77-c4ea-4613-b854-ae5888f00e64 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:04.351613 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 320/628] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:04.351613 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32397a77-c4ea-4613-b854-ae5888f00e64 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.362466 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:04.418859 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9d356-c251-47da-b311-462fa9ada889 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.455221 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a448510-d8d1-44e2-986a-6e1e67415250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.455874 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a448510-d8d1-44e2-986a-6e1e67415250 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.456157 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a448510-d8d1-44e2-986a-6e1e67415250 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.456435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a448510-d8d1-44e2-986a-6e1e67415250 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.457683 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32397a77-c4ea-4613-b854-ae5888f00e64 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.465040 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a448510-d8d1-44e2-986a-6e1e67415250 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:04.466943 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a448510-d8d1-44e2-986a-6e1e67415250 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-5a448510-d8d1-44e2-986a-6e1e67415250 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:04.480318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:04.481435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:04.482363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:04.482363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:04.482363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:04.482363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:04.482363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:04.482363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:04.482363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:04.482363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:04.482363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 309/629] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:04.482934 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a448510-d8d1-44e2-986a-6e1e67415250 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.496481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b617161-3010-46f4-a41d-9f45026605cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.497107 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b617161-3010-46f4-a41d-9f45026605cf None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.497383 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b617161-3010-46f4-a41d-9f45026605cf None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.497654 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b617161-3010-46f4-a41d-9f45026605cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.508427 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b617161-3010-46f4-a41d-9f45026605cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:04.509858 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b617161-3010-46f4-a41d-9f45026605cf None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-9b617161-3010-46f4-a41d-9f45026605cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:04.526237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:04.527258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:04.528753 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:04.528753 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:04.528753 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:04.528753 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 321/630] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:04.528753 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b617161-3010-46f4-a41d-9f45026605cf None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.555172 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:04.602702 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a448510-d8d1-44e2-986a-6e1e67415250 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.612795 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:04.641156 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5c34b-fc7d-4a71-9c4e-956db109ab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.641763 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b617161-3010-46f4-a41d-9f45026605cf None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.642200 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5c34b-fc7d-4a71-9c4e-956db109ab83 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.642200 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5c34b-fc7d-4a71-9c4e-956db109ab83 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.642336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5c34b-fc7d-4a71-9c4e-956db109ab83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.649860 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5c34b-fc7d-4a71-9c4e-956db109ab83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:04.651318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5c34b-fc7d-4a71-9c4e-956db109ab83 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-87a5c34b-fc7d-4a71-9c4e-956db109ab83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:04.663300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:04.665014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:04.666005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:04.666005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:04.666005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:04.666005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:04.666005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:04.666005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:04.666005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:04.666005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:04.666005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 310/631] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:04.666005 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5c34b-fc7d-4a71-9c4e-956db109ab83 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.686988 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e5f37-bc53-4616-84bc-6e0e741ed92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.687963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e5f37-bc53-4616-84bc-6e0e741ed92c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.688668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e5f37-bc53-4616-84bc-6e0e741ed92c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.689098 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e5f37-bc53-4616-84bc-6e0e741ed92c None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.689936 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e5f37-bc53-4616-84bc-6e0e741ed92c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:04.690381 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e5f37-bc53-4616-84bc-6e0e741ed92c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:04.692897 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e5f37-bc53-4616-84bc-6e0e741ed92c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:04.712126 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 322/632] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:04.713101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e5f37-bc53-4616-84bc-6e0e741ed92c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.784775 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5c34b-fc7d-4a71-9c4e-956db109ab83 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.804385 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:04.826813 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e5f37-bc53-4616-84bc-6e0e741ed92c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.827755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ef59a-f8b8-4856-b864-85c7ac500760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.828462 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ef59a-f8b8-4856-b864-85c7ac500760 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.828800 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ef59a-f8b8-4856-b864-85c7ac500760 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.829142 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ef59a-f8b8-4856-b864-85c7ac500760 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.829856 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ef59a-f8b8-4856-b864-85c7ac500760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:04.830221 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ef59a-f8b8-4856-b864-85c7ac500760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:04.831593 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ef59a-f8b8-4856-b864-85c7ac500760 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:04.844492 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 311/633] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:04.849640 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ef59a-f8b8-4856-b864-85c7ac500760 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.863065 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2b237-90d5-4552-9595-fb7bfff20a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.863662 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2b237-90d5-4552-9595-fb7bfff20a10 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.863967 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2b237-90d5-4552-9595-fb7bfff20a10 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.864240 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2b237-90d5-4552-9595-fb7bfff20a10 None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.864924 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2b237-90d5-4552-9595-fb7bfff20a10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:04.865792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2b237-90d5-4552-9595-fb7bfff20a10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:04.867354 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2b237-90d5-4552-9595-fb7bfff20a10 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:04.884711 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 323/634] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:04.884711 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2b237-90d5-4552-9595-fb7bfff20a10 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:04.884990 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:04.961651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ef59a-f8b8-4856-b864-85c7ac500760 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.993186 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2b237-90d5-4552-9595-fb7bfff20a10 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:04.996252 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83f2f-7268-42fa-985d-7adf238f187c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:04.996847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83f2f-7268-42fa-985d-7adf238f187c None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:04.997123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83f2f-7268-42fa-985d-7adf238f187c None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:04.997392 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83f2f-7268-42fa-985d-7adf238f187c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:04.998098 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b83f2f-7268-42fa-985d-7adf238f187c None admin] RBAC: Adding query filter params (role.id=3db17b52a09844b88bc370419f6c6265, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=18eb03a1a720431a9c78883a0aab8741) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:04.998401 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b83f2f-7268-42fa-985d-7adf238f187c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:04.999847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b83f2f-7268-42fa-985d-7adf238f187c None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:05.005458 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 312/635] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:04 2022] GET /identity/v3/role_assignments?user.id=18eb03a1a720431a9c78883a0aab8741&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=3db17b52a09844b88bc370419f6c6265 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:05.007232 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83f2f-7268-42fa-985d-7adf238f187c None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:05.032667 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db42e4-bab3-4e68-a447-6d533f8d8cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:05.033668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db42e4-bab3-4e68-a447-6d533f8d8cb3 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.033951 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db42e4-bab3-4e68-a447-6d533f8d8cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.034228 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db42e4-bab3-4e68-a447-6d533f8d8cb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.042568 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db42e4-bab3-4e68-a447-6d533f8d8cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:05.044104 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db42e4-bab3-4e68-a447-6d533f8d8cb3 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-19db42e4-bab3-4e68-a447-6d533f8d8cb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:05.057260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:05.058376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:05.064392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:05.064392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:05.064392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:05.064392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:05.064392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:05.064392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:05.064392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:05.064392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:05.064392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 324/636] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:05.064392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ccec4-a276-4230-ab99-4b6972969aab None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.064392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ccec4-a276-4230-ab99-4b6972969aab None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.064992 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ccec4-a276-4230-ab99-4b6972969aab None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.064992 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 325/637] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:05.064992 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ccec4-a276-4230-ab99-4b6972969aab None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:05.067917 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:05.136987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:05.148548 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83f2f-7268-42fa-985d-7adf238f187c None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:05.186902 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df9583-26e1-4fff-bc20-4c252d45d947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:05.187509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df9583-26e1-4fff-bc20-4c252d45d947 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.187873 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df9583-26e1-4fff-bc20-4c252d45d947 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.188096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df9583-26e1-4fff-bc20-4c252d45d947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.188485 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ccec4-a276-4230-ab99-4b6972969aab None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:05.188824 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df9583-26e1-4fff-bc20-4c252d45d947 None admin] RBAC: Adding query filter params (role.id=3db17b52a09844b88bc370419f6c6265, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=60819c30ec7c42d1a1891e7ce07f8473) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:05.189135 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df9583-26e1-4fff-bc20-4c252d45d947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:05.190573 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df9583-26e1-4fff-bc20-4c252d45d947 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:05.199356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 313/638] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:05 2022] GET /identity/v3/role_assignments?user.id=60819c30ec7c42d1a1891e7ce07f8473&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=3db17b52a09844b88bc370419f6c6265 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:05.200740 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cd87a-6580-4523-a206-a51ff47530f6 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.201028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cd87a-6580-4523-a206-a51ff47530f6 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.201301 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cd87a-6580-4523-a206-a51ff47530f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.225846 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-034cd87a-6580-4523-a206-a51ff47530f6 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:05.227277 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-034cd87a-6580-4523-a206-a51ff47530f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:05.245722 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720f394-4766-4149-ac09-b47bbd146d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:05.246284 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720f394-4766-4149-ac09-b47bbd146d7f None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.246545 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720f394-4766-4149-ac09-b47bbd146d7f None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.246823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720f394-4766-4149-ac09-b47bbd146d7f None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.247559 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720f394-4766-4149-ac09-b47bbd146d7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:05.247894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720f394-4766-4149-ac09-b47bbd146d7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:05.249387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720f394-4766-4149-ac09-b47bbd146d7f None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:05.267058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 326/639] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:05.278932 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720f394-4766-4149-ac09-b47bbd146d7f None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:05.326728 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 314/640] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:05.370001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:05.409379 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720f394-4766-4149-ac09-b47bbd146d7f None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:05.445578 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c426aa-8dea-4302-982d-f98bf91b3400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:05.446183 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c426aa-8dea-4302-982d-f98bf91b3400 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.446460 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c426aa-8dea-4302-982d-f98bf91b3400 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.446729 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c426aa-8dea-4302-982d-f98bf91b3400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.447451 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c426aa-8dea-4302-982d-f98bf91b3400 None admin] RBAC: Adding query filter params (role.id=3db17b52a09844b88bc370419f6c6265, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=b57524e5da8647a1a258f8c1e4258b62) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:05.447755 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c426aa-8dea-4302-982d-f98bf91b3400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:05.449216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c426aa-8dea-4302-982d-f98bf91b3400 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:05.455987 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 327/641] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:05 2022] GET /identity/v3/role_assignments?user.id=b57524e5da8647a1a258f8c1e4258b62&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=3db17b52a09844b88bc370419f6c6265 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:05.675444 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cd87a-6580-4523-a206-a51ff47530f6 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:05.767116 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:05.783300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cd87a-6580-4523-a206-a51ff47530f6 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:05.821340 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50442be8-d6ef-4ca5-b917-97ff930853f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:05.821976 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50442be8-d6ef-4ca5-b917-97ff930853f5 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.822257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50442be8-d6ef-4ca5-b917-97ff930853f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.822533 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50442be8-d6ef-4ca5-b917-97ff930853f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.833361 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50442be8-d6ef-4ca5-b917-97ff930853f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-50442be8-d6ef-4ca5-b917-97ff930853f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:05.838887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:05.839939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:05.840847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 315/642] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:08:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:05.848147 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c426aa-8dea-4302-982d-f98bf91b3400 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:05.956545 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c426aa-8dea-4302-982d-f98bf91b3400 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:05.987628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:05.996935 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002202b7-77bc-4385-bc13-0b4ffcf3329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:05.997594 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002202b7-77bc-4385-bc13-0b4ffcf3329a None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:05.997879 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002202b7-77bc-4385-bc13-0b4ffcf3329a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:05.998158 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002202b7-77bc-4385-bc13-0b4ffcf3329a None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:05.998826 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002202b7-77bc-4385-bc13-0b4ffcf3329a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:05.999132 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002202b7-77bc-4385-bc13-0b4ffcf3329a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:06.000641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002202b7-77bc-4385-bc13-0b4ffcf3329a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:06.015101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 328/643] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:06.016284 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50442be8-d6ef-4ca5-b917-97ff930853f5 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:06.123558 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50442be8-d6ef-4ca5-b917-97ff930853f5 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:06.164615 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1289-b477-4c91-a293-17ed897d4c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:06.165226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1289-b477-4c91-a293-17ed897d4c0a None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:06.165505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1289-b477-4c91-a293-17ed897d4c0a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:06.165771 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff1289-b477-4c91-a293-17ed897d4c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:06.176143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff1289-b477-4c91-a293-17ed897d4c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:06.178133 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff1289-b477-4c91-a293-17ed897d4c0a None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:06.185190 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-3cff1289-b477-4c91-a293-17ed897d4c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:06.193021 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:06.194778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:06.195677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:06.195677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:06.195677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:06.195677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 316/644] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:06.200467 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002202b7-77bc-4385-bc13-0b4ffcf3329a None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:06.312491 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002202b7-77bc-4385-bc13-0b4ffcf3329a None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:06.351483 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714abc96-ddd1-40e9-a7c8-449f18e94db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:06.352123 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714abc96-ddd1-40e9-a7c8-449f18e94db0 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:06.352406 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714abc96-ddd1-40e9-a7c8-449f18e94db0 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:06.352682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714abc96-ddd1-40e9-a7c8-449f18e94db0 None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:06.353338 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714abc96-ddd1-40e9-a7c8-449f18e94db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:06.353646 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714abc96-ddd1-40e9-a7c8-449f18e94db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:06.355022 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714abc96-ddd1-40e9-a7c8-449f18e94db0 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:06.368077 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 329/645] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:06.373498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1289-b477-4c91-a293-17ed897d4c0a None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:06.481006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff1289-b477-4c91-a293-17ed897d4c0a None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:06.516372 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d64b5c-2868-4141-9758-ab3978cf6443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:06.517027 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64b5c-2868-4141-9758-ab3978cf6443 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:06.517309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64b5c-2868-4141-9758-ab3978cf6443 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:06.517574 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d64b5c-2868-4141-9758-ab3978cf6443 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:06.526185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d64b5c-2868-4141-9758-ab3978cf6443 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:06.527631 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d64b5c-2868-4141-9758-ab3978cf6443 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-d3d64b5c-2868-4141-9758-ab3978cf6443 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:06.539257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:06.540272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:06.541245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:06.541245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:06.541245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:06.541245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:06.541245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:06.541245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:06.541245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:06.541245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:06.541245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:06.541245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:06.541245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 317/646] 10.222.0.58 () {56 vars in 1093 bytes} [Tue Aug 23 22:08:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:06.547543 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714abc96-ddd1-40e9-a7c8-449f18e94db0 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:06.602167 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:06.657643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714abc96-ddd1-40e9-a7c8-449f18e94db0 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:06.694254 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d407d71-5837-4b0b-89b6-0b1aeda67c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:06.695332 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d407d71-5837-4b0b-89b6-0b1aeda67c38 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:06.695823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d407d71-5837-4b0b-89b6-0b1aeda67c38 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:06.696351 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d407d71-5837-4b0b-89b6-0b1aeda67c38 None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:06.697322 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d407d71-5837-4b0b-89b6-0b1aeda67c38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:06.697860 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d407d71-5837-4b0b-89b6-0b1aeda67c38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:06.699601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d407d71-5837-4b0b-89b6-0b1aeda67c38 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:06.719672 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 330/647] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Aug 23 22:08:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:06.726236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d64b5c-2868-4141-9758-ab3978cf6443 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:06.787246 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:06.831330 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d64b5c-2868-4141-9758-ab3978cf6443 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:06.866967 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf82544-4694-44b9-be1f-28f85a7f58da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:06.867568 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82544-4694-44b9-be1f-28f85a7f58da None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:06.867867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82544-4694-44b9-be1f-28f85a7f58da None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:06.868142 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf82544-4694-44b9-be1f-28f85a7f58da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:06.937913 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf82544-4694-44b9-be1f-28f85a7f58da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:06.939370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf82544-4694-44b9-be1f-28f85a7f58da None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:06.998633 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:07.043591 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 318/648] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 22:08:07.048755 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d407d71-5837-4b0b-89b6-0b1aeda67c38 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:07.152800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d407d71-5837-4b0b-89b6-0b1aeda67c38 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:07.160914 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:07.190877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12927786-36f3-47ce-b854-01f6bc7d2e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:07.191504 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927786-36f3-47ce-b854-01f6bc7d2e08 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.191782 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927786-36f3-47ce-b854-01f6bc7d2e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.192081 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927786-36f3-47ce-b854-01f6bc7d2e08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.207959 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12927786-36f3-47ce-b854-01f6bc7d2e08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:07.209547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12927786-36f3-47ce-b854-01f6bc7d2e08 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-12927786-36f3-47ce-b854-01f6bc7d2e08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:07.225671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:07.226658 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:07.227539 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:07.227539 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:07.227539 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:07.227539 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 331/649] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:07.235960 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf82544-4694-44b9-be1f-28f85a7f58da None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:07.349152 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf82544-4694-44b9-be1f-28f85a7f58da None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:07.387251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51736628-a1eb-4b35-a88b-4c6ea0afe670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:07.387874 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51736628-a1eb-4b35-a88b-4c6ea0afe670 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.388159 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51736628-a1eb-4b35-a88b-4c6ea0afe670 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.388432 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51736628-a1eb-4b35-a88b-4c6ea0afe670 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.389069 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51736628-a1eb-4b35-a88b-4c6ea0afe670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:07.389366 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51736628-a1eb-4b35-a88b-4c6ea0afe670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:07.390729 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51736628-a1eb-4b35-a88b-4c6ea0afe670 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:07.402993 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 319/650] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:07.408070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12927786-36f3-47ce-b854-01f6bc7d2e08 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:07.446666 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951adba-f88f-45d9-b5e8-778ce03dd873 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.447002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951adba-f88f-45d9-b5e8-778ce03dd873 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.447226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951adba-f88f-45d9-b5e8-778ce03dd873 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.448875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 320/651] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:07.454248 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb020de8-4b6e-4003-ac39-07c8f5078b45 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.454721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb020de8-4b6e-4003-ac39-07c8f5078b45 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.455153 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb020de8-4b6e-4003-ac39-07c8f5078b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.475147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-fb020de8-4b6e-4003-ac39-07c8f5078b45 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:07.476475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-fb020de8-4b6e-4003-ac39-07c8f5078b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:07.493456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:07.526445 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12927786-36f3-47ce-b854-01f6bc7d2e08 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:07.563953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 321/652] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:08:07.564272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c823a5-b0a8-41da-bc76-8b6ad1b8c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:07.564899 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c823a5-b0a8-41da-bc76-8b6ad1b8c49b None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.565321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c823a5-b0a8-41da-bc76-8b6ad1b8c49b None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.565674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c823a5-b0a8-41da-bc76-8b6ad1b8c49b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.573042 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c823a5-b0a8-41da-bc76-8b6ad1b8c49b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:07.574677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c823a5-b0a8-41da-bc76-8b6ad1b8c49b None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-47c823a5-b0a8-41da-bc76-8b6ad1b8c49b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:07.587547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:07.589628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:07.591717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:07.591717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:07.591717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:07.591717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:07.591717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:07.591717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:07.591717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:07.591717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:07.591717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 332/653] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:07.595742 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb020de8-4b6e-4003-ac39-07c8f5078b45 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:07.661273 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99f2b-70ce-4356-a73f-8243765dd2c5 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.662485 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99f2b-70ce-4356-a73f-8243765dd2c5 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.662970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e99f2b-70ce-4356-a73f-8243765dd2c5 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.664619 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 333/654] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:07.673269 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55a574-69de-4123-99ad-a70514b16a47 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.673560 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55a574-69de-4123-99ad-a70514b16a47 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.673836 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55a574-69de-4123-99ad-a70514b16a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.699368 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-cb55a574-69de-4123-99ad-a70514b16a47 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:07.700595 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-cb55a574-69de-4123-99ad-a70514b16a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:07.714886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb020de8-4b6e-4003-ac39-07c8f5078b45 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:07.721009 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:07.760435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b335525-18cb-4a1b-9b52-779883ea0da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:07.761033 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b335525-18cb-4a1b-9b52-779883ea0da7 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.761033 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b335525-18cb-4a1b-9b52-779883ea0da7 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.761264 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b335525-18cb-4a1b-9b52-779883ea0da7 None admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.761964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b335525-18cb-4a1b-9b52-779883ea0da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:07.762270 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b335525-18cb-4a1b-9b52-779883ea0da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:07.763782 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b335525-18cb-4a1b-9b52-779883ea0da7 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:07.778376 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 322/655] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:07.783983 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b335525-18cb-4a1b-9b52-779883ea0da7 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:07.796752 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:07.810011 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 334/656] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:07.892115 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe204-99c6-46f0-890f-b27a3f738be0 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.892456 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe204-99c6-46f0-890f-b27a3f738be0 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.892673 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdafe204-99c6-46f0-890f-b27a3f738be0 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.894248 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 335/657] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:07.898252 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b335525-18cb-4a1b-9b52-779883ea0da7 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:07.899086 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dffc0-385c-40bd-a476-c49c6228c1db None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.899368 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dffc0-385c-40bd-a476-c49c6228c1db None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.899641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dffc0-385c-40bd-a476-c49c6228c1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.937846 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61089366-5734-4fab-b070-02f1087272b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:07.938755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61089366-5734-4fab-b070-02f1087272b6 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:07.939189 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61089366-5734-4fab-b070-02f1087272b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:07.939643 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61089366-5734-4fab-b070-02f1087272b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:07.940587 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61089366-5734-4fab-b070-02f1087272b6 None admin] RBAC: Adding query filter params (role.id=81a7cb1c95fd45708dbee5e4dc91626b, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=d43a6040fd95466fa17acdb1f30476ab) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:07.941053 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61089366-5734-4fab-b070-02f1087272b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:07.942680 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61089366-5734-4fab-b070-02f1087272b6 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:07.950554 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 323/658] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:07 2022] GET /identity/v3/role_assignments?user.id=d43a6040fd95466fa17acdb1f30476ab&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=81a7cb1c95fd45708dbee5e4dc91626b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:07.951769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61089366-5734-4fab-b070-02f1087272b6 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.045393 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:08.049535 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-857dffc0-385c-40bd-a476-c49c6228c1db None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:08.050779 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-857dffc0-385c-40bd-a476-c49c6228c1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:08.087804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61089366-5734-4fab-b070-02f1087272b6 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.135521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cbc60-c099-40af-a266-8358178cd889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.136603 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cbc60-c099-40af-a266-8358178cd889 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.137104 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cbc60-c099-40af-a266-8358178cd889 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.137571 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628cbc60-c099-40af-a266-8358178cd889 None admin] PATH_INFO: `/v3/services/image` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.138351 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cbc60-c099-40af-a266-8358178cd889 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.140096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628cbc60-c099-40af-a266-8358178cd889 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.140291 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 336/659] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:08:08.143752 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dffc0-385c-40bd-a476-c49c6228c1db None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-628cbc60-c099-40af-a266-8358178cd889 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:08.154561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:08.155656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:08:08.156563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:08.160011 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 324/660] 10.222.0.58 () {56 vars in 1105 bytes} [Tue Aug 23 22:08:07 2022] GET /identity/v3/services/image => generated 86 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:08.162504 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cbc60-c099-40af-a266-8358178cd889 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.264220 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:08.288232 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628cbc60-c099-40af-a266-8358178cd889 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.292480 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dffc0-385c-40bd-a476-c49c6228c1db None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.332188 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6391b6-4244-4b6f-bcc1-a8d0367ee3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.332800 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6391b6-4244-4b6f-bcc1-a8d0367ee3b9 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.333098 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6391b6-4244-4b6f-bcc1-a8d0367ee3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.333373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6391b6-4244-4b6f-bcc1-a8d0367ee3b9 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.334632 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6391b6-4244-4b6f-bcc1-a8d0367ee3b9 None admin] RBAC: Adding query filter params (name=image) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:08.334965 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6391b6-4244-4b6f-bcc1-a8d0367ee3b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.336404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6391b6-4244-4b6f-bcc1-a8d0367ee3b9 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.338408 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:08.341643 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 325/661] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:08.346835 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6391b6-4244-4b6f-bcc1-a8d0367ee3b9 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.347125 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878bc61-faad-4b9a-8e3f-4fb6220f5b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.348116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878bc61-faad-4b9a-8e3f-4fb6220f5b77 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.348592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878bc61-faad-4b9a-8e3f-4fb6220f5b77 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.349070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878bc61-faad-4b9a-8e3f-4fb6220f5b77 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.350465 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878bc61-faad-4b9a-8e3f-4fb6220f5b77 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.352226 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878bc61-faad-4b9a-8e3f-4fb6220f5b77 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-2878bc61-faad-4b9a-8e3f-4fb6220f5b77 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:08.363378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:08.364573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:08:08.365973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:08.368707 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 337/662] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:08.373972 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878bc61-faad-4b9a-8e3f-4fb6220f5b77 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.465371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6391b6-4244-4b6f-bcc1-a8d0367ee3b9 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.491939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878bc61-faad-4b9a-8e3f-4fb6220f5b77 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.504072 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39668857-0a12-4e51-90df-af6028f195d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.504613 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39668857-0a12-4e51-90df-af6028f195d1 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.504900 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39668857-0a12-4e51-90df-af6028f195d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.505175 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39668857-0a12-4e51-90df-af6028f195d1 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.505924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39668857-0a12-4e51-90df-af6028f195d1 None admin] RBAC: Adding query filter params (type=image) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:08.506224 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39668857-0a12-4e51-90df-af6028f195d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.507603 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39668857-0a12-4e51-90df-af6028f195d1 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.513638 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 326/663] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:08.514523 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39668857-0a12-4e51-90df-af6028f195d1 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.541754 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea4e4b-5094-49c7-a50c-a474401bd18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.542825 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea4e4b-5094-49c7-a50c-a474401bd18c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.543317 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea4e4b-5094-49c7-a50c-a474401bd18c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.543785 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea4e4b-5094-49c7-a50c-a474401bd18c None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.544830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea4e4b-5094-49c7-a50c-a474401bd18c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:08.545362 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea4e4b-5094-49c7-a50c-a474401bd18c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.547103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea4e4b-5094-49c7-a50c-a474401bd18c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.553692 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 338/664] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:08.563875 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea4e4b-5094-49c7-a50c-a474401bd18c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.576694 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:08.601262 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:08.648010 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39668857-0a12-4e51-90df-af6028f195d1 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.689292 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f39ba-41b7-4e61-b14d-6da8eb0257d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.689933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f39ba-41b7-4e61-b14d-6da8eb0257d5 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.690220 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f39ba-41b7-4e61-b14d-6da8eb0257d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.690489 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f39ba-41b7-4e61-b14d-6da8eb0257d5 None admin] PATH_INFO: `/v3/services/network` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.691196 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f39ba-41b7-4e61-b14d-6da8eb0257d5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.692688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6f39ba-41b7-4e61-b14d-6da8eb0257d5 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-5a6f39ba-41b7-4e61-b14d-6da8eb0257d5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:08.705418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:08.706471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:08.707309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 327/665] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:08.717188 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f39ba-41b7-4e61-b14d-6da8eb0257d5 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.717857 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea4e4b-5094-49c7-a50c-a474401bd18c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.769328 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390401d0-508c-42e4-9282-7a32b93a7b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.770348 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390401d0-508c-42e4-9282-7a32b93a7b0a None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.770835 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390401d0-508c-42e4-9282-7a32b93a7b0a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.771405 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390401d0-508c-42e4-9282-7a32b93a7b0a None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.772436 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390401d0-508c-42e4-9282-7a32b93a7b0a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:08.772980 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390401d0-508c-42e4-9282-7a32b93a7b0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.774769 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390401d0-508c-42e4-9282-7a32b93a7b0a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.781824 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 339/666] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:08.838985 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f39ba-41b7-4e61-b14d-6da8eb0257d5 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:08.870970 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:08.879290 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe9eb1-68eb-4115-b905-0949d6c7a3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:08.879936 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe9eb1-68eb-4115-b905-0949d6c7a3c7 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:08.880220 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe9eb1-68eb-4115-b905-0949d6c7a3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:08.881061 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe9eb1-68eb-4115-b905-0949d6c7a3c7 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:08.881732 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe9eb1-68eb-4115-b905-0949d6c7a3c7 None admin] RBAC: Adding query filter params (name=network) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:08.882025 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe9eb1-68eb-4115-b905-0949d6c7a3c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:08.883966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe9eb1-68eb-4115-b905-0949d6c7a3c7 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:08.889555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 328/667] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:08.894786 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390401d0-508c-42e4-9282-7a32b93a7b0a None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:08.976806 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:09.014810 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390401d0-508c-42e4-9282-7a32b93a7b0a None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:09.051218 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9519e-cf5c-4f2f-bb7f-d104aa06b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:09.051858 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9519e-cf5c-4f2f-bb7f-d104aa06b93e None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:09.054003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9519e-cf5c-4f2f-bb7f-d104aa06b93e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:09.054003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9519e-cf5c-4f2f-bb7f-d104aa06b93e None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:09.054857 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9519e-cf5c-4f2f-bb7f-d104aa06b93e None admin] RBAC: Adding query filter params (type=network) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:09.055199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9519e-cf5c-4f2f-bb7f-d104aa06b93e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:09.056628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9519e-cf5c-4f2f-bb7f-d104aa06b93e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:09.061677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 340/668] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:10.265146 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06819f41-2479-4fcb-82a2-ca71144ff80a None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:10.265646 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06819f41-2479-4fcb-82a2-ca71144ff80a None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:10.265722 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06819f41-2479-4fcb-82a2-ca71144ff80a None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:10.267281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 329/669] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:10.273219 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18a46c-4ec9-465c-a1c4-71e4829773e9 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:10.273626 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18a46c-4ec9-465c-a1c4-71e4829773e9 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:10.273800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18a46c-4ec9-465c-a1c4-71e4829773e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:10.292025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-8c18a46c-4ec9-465c-a1c4-71e4829773e9 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:10.293256 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-8c18a46c-4ec9-465c-a1c4-71e4829773e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:10.367245 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 341/670] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:10.698690 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06819f41-2479-4fcb-82a2-ca71144ff80a None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:10.810746 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06819f41-2479-4fcb-82a2-ca71144ff80a None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:10.847269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0b49c-9460-45ae-8223-3c37af78c85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:10.847931 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0b49c-9460-45ae-8223-3c37af78c85b None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:10.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0b49c-9460-45ae-8223-3c37af78c85b None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:10.848488 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0b49c-9460-45ae-8223-3c37af78c85b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:10.859701 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0b49c-9460-45ae-8223-3c37af78c85b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-80a0b49c-9460-45ae-8223-3c37af78c85b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:10.864364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:10.865897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:10.866755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 330/671] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:08:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:10.872099 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18a46c-4ec9-465c-a1c4-71e4829773e9 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:10.887483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418366c-8291-4896-bbd9-04a0a55646d0 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:10.887777 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418366c-8291-4896-bbd9-04a0a55646d0 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:10.888073 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418366c-8291-4896-bbd9-04a0a55646d0 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:10.889644 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 331/672] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:10.894817 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd287d-a075-4627-bc9c-f1875353de34 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:10.895109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd287d-a075-4627-bc9c-f1875353de34 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:10.895386 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd287d-a075-4627-bc9c-f1875353de34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:10.915725 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-aebd287d-a075-4627-bc9c-f1875353de34 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:10.917245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-aebd287d-a075-4627-bc9c-f1875353de34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:10.948399 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:10.976948 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:10.995722 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18a46c-4ec9-465c-a1c4-71e4829773e9 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.008247 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 332/673] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:11.032348 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a3aa8-f8dd-48ec-b613-6b27d73cab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.032952 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a3aa8-f8dd-48ec-b613-6b27d73cab72 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.033235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a3aa8-f8dd-48ec-b613-6b27d73cab72 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.033509 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a3aa8-f8dd-48ec-b613-6b27d73cab72 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.034171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a3aa8-f8dd-48ec-b613-6b27d73cab72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:11.034469 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a3aa8-f8dd-48ec-b613-6b27d73cab72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:11.035854 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a3aa8-f8dd-48ec-b613-6b27d73cab72 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:11.044870 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 342/674] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:11.050297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd287d-a075-4627-bc9c-f1875353de34 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.091008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87b61f-936d-4f7c-9020-b23cd88648bf None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.091315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87b61f-936d-4f7c-9020-b23cd88648bf None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.094948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87b61f-936d-4f7c-9020-b23cd88648bf None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.094948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 343/675] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:11.100557 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c307d88-d2c2-4ffa-85b2-b8a88e7d80a9 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.101098 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c307d88-d2c2-4ffa-85b2-b8a88e7d80a9 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.101579 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c307d88-d2c2-4ffa-85b2-b8a88e7d80a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.120992 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-2c307d88-d2c2-4ffa-85b2-b8a88e7d80a9 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:11.123190 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-2c307d88-d2c2-4ffa-85b2-b8a88e7d80a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:11.178988 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd287d-a075-4627-bc9c-f1875353de34 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.201837 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 344/676] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 22:08:11.230133 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745600a-248e-4cc4-88ff-4e98673154a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.231027 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745600a-248e-4cc4-88ff-4e98673154a0 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.231027 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745600a-248e-4cc4-88ff-4e98673154a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.231027 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745600a-248e-4cc4-88ff-4e98673154a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.247811 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745600a-248e-4cc4-88ff-4e98673154a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:11.249317 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745600a-248e-4cc4-88ff-4e98673154a0 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-1745600a-248e-4cc4-88ff-4e98673154a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:11.266002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:11.268721 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:11.270910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:11.270910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:11.270910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:11.270910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 333/677] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:11.277174 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c307d88-d2c2-4ffa-85b2-b8a88e7d80a9 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.321903 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb62ff5-08bd-4fff-aa47-b7efc6b72845 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.322262 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb62ff5-08bd-4fff-aa47-b7efc6b72845 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.322429 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb62ff5-08bd-4fff-aa47-b7efc6b72845 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.324628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 334/678] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:11.331010 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc800056-be3c-48af-b91a-1da22dcf97a0 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.331549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc800056-be3c-48af-b91a-1da22dcf97a0 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.332077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc800056-be3c-48af-b91a-1da22dcf97a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.342986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:11.352058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-cc800056-be3c-48af-b91a-1da22dcf97a0 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:11.353247 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-cc800056-be3c-48af-b91a-1da22dcf97a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:11.382882 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:11.391736 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c307d88-d2c2-4ffa-85b2-b8a88e7d80a9 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.426230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 335/679] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 22:08:11.427084 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc800056-be3c-48af-b91a-1da22dcf97a0 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.447116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0fcdf-ab00-4491-ade4-bf85d566be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.447734 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0fcdf-ab00-4491-ade4-bf85d566be9b None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.448145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0fcdf-ab00-4491-ade4-bf85d566be9b None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.448425 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0fcdf-ab00-4491-ade4-bf85d566be9b None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.449069 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0fcdf-ab00-4491-ade4-bf85d566be9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:11.449374 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0fcdf-ab00-4491-ade4-bf85d566be9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:11.450848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0fcdf-ab00-4491-ade4-bf85d566be9b None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:11.463664 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 345/680] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:11.469226 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0fcdf-ab00-4491-ade4-bf85d566be9b None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.556594 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc800056-be3c-48af-b91a-1da22dcf97a0 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.587070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0fcdf-ab00-4491-ade4-bf85d566be9b None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.598039 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e72e9-b6be-4112-be94-3a97e1a7400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.598891 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e72e9-b6be-4112-be94-3a97e1a7400c None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.600044 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e72e9-b6be-4112-be94-3a97e1a7400c None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.600473 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e72e9-b6be-4112-be94-3a97e1a7400c None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.601275 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e72e9-b6be-4112-be94-3a97e1a7400c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:11.602767 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e72e9-b6be-4112-be94-3a97e1a7400c None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:11.604984 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:11.632330 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 336/681] 10.222.0.58 () {60 vars in 1141 bytes} [Tue Aug 23 22:08:11 2022] POST /identity/v3/services => generated 242 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:11.633030 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e72e9-b6be-4112-be94-3a97e1a7400c None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.638610 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a39fa-7f88-48b6-b1fd-87b1eb829560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.639266 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a39fa-7f88-48b6-b1fd-87b1eb829560 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.639544 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a39fa-7f88-48b6-b1fd-87b1eb829560 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.639811 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a39fa-7f88-48b6-b1fd-87b1eb829560 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.649267 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a39fa-7f88-48b6-b1fd-87b1eb829560 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:11.650789 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2a39fa-7f88-48b6-b1fd-87b1eb829560 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-7f2a39fa-7f88-48b6-b1fd-87b1eb829560 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:11.664892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:11.665941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:11.667102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:11.667102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:11.667102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:11.667102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:11.667102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:11.667102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:11.667102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:11.667102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:11.667102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:11.667102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:11.667102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 346/682] 10.222.0.58 () {56 vars in 1093 bytes} [Tue Aug 23 22:08:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:11.671682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a39fa-7f88-48b6-b1fd-87b1eb829560 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.675565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:11.778958 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e72e9-b6be-4112-be94-3a97e1a7400c None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.796945 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a39fa-7f88-48b6-b1fd-87b1eb829560 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:11.815967 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a406ec-24e1-4f91-b1af-ae49f26a6e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.816571 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a406ec-24e1-4f91-b1af-ae49f26a6e98 None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.816860 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a406ec-24e1-4f91-b1af-ae49f26a6e98 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.817137 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a406ec-24e1-4f91-b1af-ae49f26a6e98 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.817799 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a406ec-24e1-4f91-b1af-ae49f26a6e98 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:11.819799 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a406ec-24e1-4f91-b1af-ae49f26a6e98 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:11.837931 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 337/683] 10.222.0.58 () {60 vars in 1141 bytes} [Tue Aug 23 22:08:11 2022] POST /identity/v3/services => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:11.838464 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a406ec-24e1-4f91-b1af-ae49f26a6e98 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.847719 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274eaccc-4198-40ce-a60d-a0329f786df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:11.848383 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274eaccc-4198-40ce-a60d-a0329f786df0 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:11.848660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274eaccc-4198-40ce-a60d-a0329f786df0 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:11.848955 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274eaccc-4198-40ce-a60d-a0329f786df0 None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:11.850552 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274eaccc-4198-40ce-a60d-a0329f786df0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:11.850986 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274eaccc-4198-40ce-a60d-a0329f786df0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:11.852518 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274eaccc-4198-40ce-a60d-a0329f786df0 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:11.876797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 347/684] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Aug 23 22:08:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:11.884964 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274eaccc-4198-40ce-a60d-a0329f786df0 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:11.929974 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:11.958301 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:11.983723 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a406ec-24e1-4f91-b1af-ae49f26a6e98 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:12.022978 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274eaccc-4198-40ce-a60d-a0329f786df0 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:12.041444 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e9983-55e9-4d4b-87e5-8f2687ea8882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:12.042335 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e9983-55e9-4d4b-87e5-8f2687ea8882 None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.042639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e9983-55e9-4d4b-87e5-8f2687ea8882 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.042922 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e9983-55e9-4d4b-87e5-8f2687ea8882 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.044742 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e9983-55e9-4d4b-87e5-8f2687ea8882 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:12.045317 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e9983-55e9-4d4b-87e5-8f2687ea8882 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:12.065076 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ca2ea-9e56-4e03-adcf-7c0083c8aa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:12.065707 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ca2ea-9e56-4e03-adcf-7c0083c8aa1f None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.066038 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ca2ea-9e56-4e03-adcf-7c0083c8aa1f None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.066259 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ca2ea-9e56-4e03-adcf-7c0083c8aa1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.067349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 338/685] 10.222.0.58 () {60 vars in 1141 bytes} [Tue Aug 23 22:08:11 2022] POST /identity/v3/services => generated 240 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:12.082225 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ca2ea-9e56-4e03-adcf-7c0083c8aa1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:12.083781 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ca2ea-9e56-4e03-adcf-7c0083c8aa1f None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-2c4ca2ea-9e56-4e03-adcf-7c0083c8aa1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:12.101058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:12.102074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:12.103859 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:12.103859 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:12.103859 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:12.103859 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 348/686] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:12.108338 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e9983-55e9-4d4b-87e5-8f2687ea8882 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:12.238025 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e9983-55e9-4d4b-87e5-8f2687ea8882 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:12.279362 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b6be4-6397-4d59-b74f-fa55956ea082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:12.280093 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b6be4-6397-4d59-b74f-fa55956ea082 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.280305 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b6be4-6397-4d59-b74f-fa55956ea082 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.280545 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b6be4-6397-4d59-b74f-fa55956ea082 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.281190 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b6be4-6397-4d59-b74f-fa55956ea082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:12.281493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b6be4-6397-4d59-b74f-fa55956ea082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:12.282861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b6be4-6397-4d59-b74f-fa55956ea082 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:12.293153 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:12.296671 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 339/687] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:12.301592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ca2ea-9e56-4e03-adcf-7c0083c8aa1f None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:12.396058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:12.419880 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ca2ea-9e56-4e03-adcf-7c0083c8aa1f None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:12.457913 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb3edd-4b16-4051-bfd3-71d9f8c0baec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:12.458611 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb3edd-4b16-4051-bfd3-71d9f8c0baec None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.458898 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb3edd-4b16-4051-bfd3-71d9f8c0baec None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.459178 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb3edd-4b16-4051-bfd3-71d9f8c0baec None admin] PATH_INFO: `/v3/projects/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.466261 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb3edd-4b16-4051-bfd3-71d9f8c0baec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:12.467704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb3edd-4b16-4051-bfd3-71d9f8c0baec None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-d5bb3edd-4b16-4051-bfd3-71d9f8c0baec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:12.481010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:12.482129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:12.483223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:12.483223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:12.483223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:12.483223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:12.483223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:12.483223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:12.483223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:12.483223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:12.483223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 349/688] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:12.489551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b6be4-6397-4d59-b74f-fa55956ea082 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:12.601473 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b6be4-6397-4d59-b74f-fa55956ea082 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:12.637220 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5dfc55-9f10-4f7e-8bae-a07245b6b9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:12.637830 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dfc55-9f10-4f7e-8bae-a07245b6b9c5 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.638115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dfc55-9f10-4f7e-8bae-a07245b6b9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.638392 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5dfc55-9f10-4f7e-8bae-a07245b6b9c5 None admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.639078 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dfc55-9f10-4f7e-8bae-a07245b6b9c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:12.639388 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dfc55-9f10-4f7e-8bae-a07245b6b9c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:12.640853 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5dfc55-9f10-4f7e-8bae-a07245b6b9c5 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:12.654813 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 340/689] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:12.660943 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb3edd-4b16-4051-bfd3-71d9f8c0baec None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:12.775587 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb3edd-4b16-4051-bfd3-71d9f8c0baec None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:12.815740 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebfed2-33bb-4eec-800a-f411908aab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:12.816786 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebfed2-33bb-4eec-800a-f411908aab0e None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:12.817140 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebfed2-33bb-4eec-800a-f411908aab0e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:12.817484 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebfed2-33bb-4eec-800a-f411908aab0e None admin] PATH_INFO: `/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/d43a6040fd95466fa17acdb1f30476ab/roles/81a7cb1c95fd45708dbee5e4dc91626b` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:12.819527 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebfed2-33bb-4eec-800a-f411908aab0e None admin] RBAC: Authorizing `identity:create_grant(project_id=0d86eb186aa94e1bb4a358cfc19447b1, user_id=d43a6040fd95466fa17acdb1f30476ab, role_id=81a7cb1c95fd45708dbee5e4dc91626b)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:12.821073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebfed2-33bb-4eec-800a-f411908aab0e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:12.832083 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:12.838838 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 350/690] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:08:12 2022] PUT /identity/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/d43a6040fd95466fa17acdb1f30476ab/roles/81a7cb1c95fd45708dbee5e4dc91626b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:08:14.022373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5299-db3e-4e81-83b4-c9a9ac851ca4 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.022899 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5299-db3e-4e81-83b4-c9a9ac851ca4 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.022899 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b5299-db3e-4e81-83b4-c9a9ac851ca4 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.024551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 341/691] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:14.029990 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6431801-cd59-4a7d-a363-0c3a2893895d None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.030401 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6431801-cd59-4a7d-a363-0c3a2893895d None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.030543 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6431801-cd59-4a7d-a363-0c3a2893895d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.049575 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-a6431801-cd59-4a7d-a363-0c3a2893895d None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:14.050767 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-a6431801-cd59-4a7d-a363-0c3a2893895d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:14.132797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 351/692] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:14.272666 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4e3b6-b748-41a7-9d22-cfc492dbbead None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.272972 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4e3b6-b748-41a7-9d22-cfc492dbbead None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.273157 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4e3b6-b748-41a7-9d22-cfc492dbbead None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.274717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 342/693] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:14.280790 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779a62b-a994-4b18-9619-7863fd7b3a78 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.281413 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779a62b-a994-4b18-9619-7863fd7b3a78 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.281891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779a62b-a994-4b18-9619-7863fd7b3a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.302770 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-8779a62b-a994-4b18-9619-7863fd7b3a78 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:14.304369 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-8779a62b-a994-4b18-9619-7863fd7b3a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:14.378160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 352/694] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:14.436475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fc893-7a1e-4ae8-b9b0-168cd3036426 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.436818 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fc893-7a1e-4ae8-b9b0-168cd3036426 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.437022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fc893-7a1e-4ae8-b9b0-168cd3036426 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.438599 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 343/695] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:14.444445 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0a0b2-6b1f-4dde-abfd-249b73764424 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.444729 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0a0b2-6b1f-4dde-abfd-249b73764424 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.445002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0a0b2-6b1f-4dde-abfd-249b73764424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.463886 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-8de0a0b2-6b1f-4dde-abfd-249b73764424 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:14.465072 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-8de0a0b2-6b1f-4dde-abfd-249b73764424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:14.506140 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fc893-7a1e-4ae8-b9b0-168cd3036426 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:14.523133 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:14.543878 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 353/696] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:14.583086 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:14.624986 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fc893-7a1e-4ae8-b9b0-168cd3036426 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:14.666333 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5887f4-2d7c-4252-a816-1be004e67dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:14.666977 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5887f4-2d7c-4252-a816-1be004e67dc2 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.667255 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5887f4-2d7c-4252-a816-1be004e67dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.667530 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5887f4-2d7c-4252-a816-1be004e67dc2 None admin] PATH_INFO: `/v3/services/image` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.668153 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5887f4-2d7c-4252-a816-1be004e67dc2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:14.669588 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5887f4-2d7c-4252-a816-1be004e67dc2 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-7b5887f4-2d7c-4252-a816-1be004e67dc2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:14.679209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:14.680420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:14.681461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 344/697] 10.222.0.58 () {56 vars in 1105 bytes} [Tue Aug 23 22:08:14 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:14.688275 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0a0b2-6b1f-4dde-abfd-249b73764424 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:14.762824 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5887f4-2d7c-4252-a816-1be004e67dc2 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:14.803588 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0a0b2-6b1f-4dde-abfd-249b73764424 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:14.851227 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb2be0-680e-4598-83f5-62c98b9c084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:14.852660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb2be0-680e-4598-83f5-62c98b9c084c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.853444 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb2be0-680e-4598-83f5-62c98b9c084c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.853945 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb2be0-680e-4598-83f5-62c98b9c084c None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.855242 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb2be0-680e-4598-83f5-62c98b9c084c None admin] RBAC: Adding query filter params (name=image) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:14.855756 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb2be0-680e-4598-83f5-62c98b9c084c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:14.858151 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb2be0-680e-4598-83f5-62c98b9c084c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:14.864761 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 354/698] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:14.872138 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb2be0-680e-4598-83f5-62c98b9c084c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:14.884688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5887f4-2d7c-4252-a816-1be004e67dc2 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:14.910314 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:14.922123 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d97d-5997-41aa-8b6c-f483f4c67617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:14.922753 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d97d-5997-41aa-8b6c-f483f4c67617 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:14.923038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d97d-5997-41aa-8b6c-f483f4c67617 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:14.923313 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26d97d-5997-41aa-8b6c-f483f4c67617 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:14.923924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26d97d-5997-41aa-8b6c-f483f4c67617 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:14.925305 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26d97d-5997-41aa-8b6c-f483f4c67617 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-cf26d97d-5997-41aa-8b6c-f483f4c67617 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:14.935103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:14.936324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:08:14.937524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:14.939100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:14.940109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 345/699] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Aug 23 22:08:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:14.943879 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d97d-5997-41aa-8b6c-f483f4c67617 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:14.998841 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb2be0-680e-4598-83f5-62c98b9c084c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.037244 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45540790-ce2f-4027-bf4d-398b62e5b5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.037880 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45540790-ce2f-4027-bf4d-398b62e5b5d5 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.038105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45540790-ce2f-4027-bf4d-398b62e5b5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.038376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45540790-ce2f-4027-bf4d-398b62e5b5d5 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.038998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45540790-ce2f-4027-bf4d-398b62e5b5d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:15.039299 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45540790-ce2f-4027-bf4d-398b62e5b5d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.040680 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45540790-ce2f-4027-bf4d-398b62e5b5d5 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.045443 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 355/700] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:15.046218 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45540790-ce2f-4027-bf4d-398b62e5b5d5 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.059006 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26d97d-5997-41aa-8b6c-f483f4c67617 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.098435 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5b2d7-cb22-4404-8055-cb9b5dc7e572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.099304 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5b2d7-cb22-4404-8055-cb9b5dc7e572 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.099682 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5b2d7-cb22-4404-8055-cb9b5dc7e572 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.100004 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5b2d7-cb22-4404-8055-cb9b5dc7e572 None admin] PATH_INFO: `/v3/services/network` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.101065 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5b2d7-cb22-4404-8055-cb9b5dc7e572 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.103535 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b5b2d7-cb22-4404-8055-cb9b5dc7e572 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-a3b5b2d7-cb22-4404-8055-cb9b5dc7e572 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:15.112477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:15.113498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:15.114334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 346/701] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:14 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:15.116589 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5b2d7-cb22-4404-8055-cb9b5dc7e572 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.163644 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45540790-ce2f-4027-bf4d-398b62e5b5d5 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.169214 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:15.180268 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:15.198374 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d00f0-d81e-41a2-bf69-9669a2b26d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.198967 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d00f0-d81e-41a2-bf69-9669a2b26d20 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.199260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d00f0-d81e-41a2-bf69-9669a2b26d20 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.199522 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d00f0-d81e-41a2-bf69-9669a2b26d20 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.200174 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d00f0-d81e-41a2-bf69-9669a2b26d20 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:15.200467 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d00f0-d81e-41a2-bf69-9669a2b26d20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.201833 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d00f0-d81e-41a2-bf69-9669a2b26d20 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.206170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 356/702] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:15.206924 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d00f0-d81e-41a2-bf69-9669a2b26d20 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.220729 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b5b2d7-cb22-4404-8055-cb9b5dc7e572 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.258934 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93be1e-6b23-47ea-8196-255319f245e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.259542 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93be1e-6b23-47ea-8196-255319f245e1 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.259834 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93be1e-6b23-47ea-8196-255319f245e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.260131 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93be1e-6b23-47ea-8196-255319f245e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.260821 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93be1e-6b23-47ea-8196-255319f245e1 None admin] RBAC: Adding query filter params (interface=public, service_id=597ce826dd364efda567e183924440c1, region_id=RegionOne) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:15.261130 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93be1e-6b23-47ea-8196-255319f245e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.262494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93be1e-6b23-47ea-8196-255319f245e1 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.269906 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 347/703] 10.222.0.58 () {56 vars in 1251 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/endpoints?service_id=597ce826dd364efda567e183924440c1&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:15.271438 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bae28-d878-4e8a-a7f9-29755d1b5bac None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.271860 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bae28-d878-4e8a-a7f9-29755d1b5bac None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.272150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bae28-d878-4e8a-a7f9-29755d1b5bac None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.273456 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 348/704] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:15.274074 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bae28-d878-4e8a-a7f9-29755d1b5bac None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.315216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d00f0-d81e-41a2-bf69-9669a2b26d20 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.349102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b478f-aef1-4cb3-b313-3713c570e8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.349715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b478f-aef1-4cb3-b313-3713c570e8fb None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.350000 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b478f-aef1-4cb3-b313-3713c570e8fb None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.350279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b478f-aef1-4cb3-b313-3713c570e8fb None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.350905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b478f-aef1-4cb3-b313-3713c570e8fb None admin] RBAC: Adding query filter params (name=network) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:15.351212 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b478f-aef1-4cb3-b313-3713c570e8fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.352637 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b478f-aef1-4cb3-b313-3713c570e8fb None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.357372 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 357/705] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:15.357978 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b478f-aef1-4cb3-b313-3713c570e8fb None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.381058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bae28-d878-4e8a-a7f9-29755d1b5bac None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.397868 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:15.405242 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:15.419596 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdea3b5-bfbe-44be-aadf-391b0cd23e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.420246 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdea3b5-bfbe-44be-aadf-391b0cd23e3f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.420520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdea3b5-bfbe-44be-aadf-391b0cd23e3f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.420787 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdea3b5-bfbe-44be-aadf-391b0cd23e3f None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.421411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdea3b5-bfbe-44be-aadf-391b0cd23e3f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:15.421708 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdea3b5-bfbe-44be-aadf-391b0cd23e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.423087 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdea3b5-bfbe-44be-aadf-391b0cd23e3f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.429559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 349/706] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:15.430503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105685d-8170-4075-9c4c-d193fe97e415 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.430785 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105685d-8170-4075-9c4c-d193fe97e415 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.431306 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105685d-8170-4075-9c4c-d193fe97e415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.465074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b478f-aef1-4cb3-b313-3713c570e8fb None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.502375 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9bbbb-8039-4dea-b8c8-c1dce225280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.502994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9bbbb-8039-4dea-b8c8-c1dce225280f None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.503273 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9bbbb-8039-4dea-b8c8-c1dce225280f None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.503543 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9bbbb-8039-4dea-b8c8-c1dce225280f None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.504185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9bbbb-8039-4dea-b8c8-c1dce225280f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.506294 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9bbbb-8039-4dea-b8c8-c1dce225280f None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.512525 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 358/707] 10.222.0.58 () {56 vars in 1087 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/services => generated 1002 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:08:15.513373 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9bbbb-8039-4dea-b8c8-c1dce225280f None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.575615 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-f105685d-8170-4075-9c4c-d193fe97e415 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:15.577231 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-f105685d-8170-4075-9c4c-d193fe97e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:15.631714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9bbbb-8039-4dea-b8c8-c1dce225280f None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.642829 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:15.660784 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 350/708] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:15 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:15.660784 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105685d-8170-4075-9c4c-d193fe97e415 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.689446 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56d2aa-2408-4ca4-8275-56c17999eb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.690299 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56d2aa-2408-4ca4-8275-56c17999eb60 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.690746 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56d2aa-2408-4ca4-8275-56c17999eb60 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.691159 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56d2aa-2408-4ca4-8275-56c17999eb60 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.692013 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56d2aa-2408-4ca4-8275-56c17999eb60 None admin] RBAC: Adding query filter params (type=network) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:15.692317 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56d2aa-2408-4ca4-8275-56c17999eb60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.694232 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56d2aa-2408-4ca4-8275-56c17999eb60 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.705030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 359/709] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:15.706236 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56d2aa-2408-4ca4-8275-56c17999eb60 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.829781 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105685d-8170-4075-9c4c-d193fe97e415 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.842489 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:15.847198 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56d2aa-2408-4ca4-8275-56c17999eb60 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:15.874869 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31bc60-c4e5-4255-b344-4e598f27ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.876058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31bc60-c4e5-4255-b344-4e598f27ff4a None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.876843 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31bc60-c4e5-4255-b344-4e598f27ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.877587 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31bc60-c4e5-4255-b344-4e598f27ff4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.878653 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31bc60-c4e5-4255-b344-4e598f27ff4a None admin] RBAC: Adding query filter params (interface=public, service_id=d9c872baa08e4c6087cbbad46deae693, region_id=RegionOne) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:15.879184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31bc60-c4e5-4255-b344-4e598f27ff4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.882082 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31bc60-c4e5-4255-b344-4e598f27ff4a None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.885261 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43336c80-e838-4373-b222-db0bb8e768b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:15.885985 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43336c80-e838-4373-b222-db0bb8e768b2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:15.886271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43336c80-e838-4373-b222-db0bb8e768b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:15.886550 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43336c80-e838-4373-b222-db0bb8e768b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:15.887304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43336c80-e838-4373-b222-db0bb8e768b2 None admin] RBAC: Adding query filter params (interface=public, service_id=331973fc78354ef7a2671fdf86b932c9, region_id=RegionOne) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:15.887623 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43336c80-e838-4373-b222-db0bb8e768b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:15.889032 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43336c80-e838-4373-b222-db0bb8e768b2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:15.889702 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 351/710] 10.222.0.58 () {56 vars in 1251 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/endpoints?service_id=d9c872baa08e4c6087cbbad46deae693&interface=public®ion_id=RegionOne => generated 194 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:15.896009 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31bc60-c4e5-4255-b344-4e598f27ff4a None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.906153 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 360/711] 10.222.0.58 () {56 vars in 1251 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/endpoints?service_id=331973fc78354ef7a2671fdf86b932c9&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:15.909359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43336c80-e838-4373-b222-db0bb8e768b2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:15.959036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:16.009396 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31bc60-c4e5-4255-b344-4e598f27ff4a None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:16.033466 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43336c80-e838-4373-b222-db0bb8e768b2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:16.048727 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521f3f6-a65d-4f8f-b1ba-04d5baa9b96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:16.049344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521f3f6-a65d-4f8f-b1ba-04d5baa9b96d None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:16.049628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521f3f6-a65d-4f8f-b1ba-04d5baa9b96d None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:16.049905 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521f3f6-a65d-4f8f-b1ba-04d5baa9b96d None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:16.050512 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521f3f6-a65d-4f8f-b1ba-04d5baa9b96d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:16.051912 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521f3f6-a65d-4f8f-b1ba-04d5baa9b96d None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:16.067874 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 352/712] 10.222.0.58 () {56 vars in 1087 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/services => generated 1002 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:08:16.067874 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521f3f6-a65d-4f8f-b1ba-04d5baa9b96d None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:16.080454 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f23bb-45b4-4490-a5be-f2d1b55cfc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:16.080981 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f23bb-45b4-4490-a5be-f2d1b55cfc63 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:16.081264 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f23bb-45b4-4490-a5be-f2d1b55cfc63 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:16.081538 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f23bb-45b4-4490-a5be-f2d1b55cfc63 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:16.082156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f23bb-45b4-4490-a5be-f2d1b55cfc63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:16.084243 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f23bb-45b4-4490-a5be-f2d1b55cfc63 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:16.091080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 361/713] 10.222.0.58 () {56 vars in 1087 bytes} [Tue Aug 23 22:08:15 2022] GET /identity/v3/services => generated 1002 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:08:16.111356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:16.196714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521f3f6-a65d-4f8f-b1ba-04d5baa9b96d None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:16.241647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a9a9a-a191-4fe9-a4a1-a748f06e0075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:16.242319 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a9a9a-a191-4fe9-a4a1-a748f06e0075 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:16.242603 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a9a9a-a191-4fe9-a4a1-a748f06e0075 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:16.242878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a9a9a-a191-4fe9-a4a1-a748f06e0075 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:16.256226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a9a9a-a191-4fe9-a4a1-a748f06e0075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-be2a9a9a-a191-4fe9-a4a1-a748f06e0075 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:08:16.261151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:16.262165 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:16.264020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 353/714] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:08:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:16.269190 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f23bb-45b4-4490-a5be-f2d1b55cfc63 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:16.380758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:16.384344 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f23bb-45b4-4490-a5be-f2d1b55cfc63 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:16.424210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85baad5-86b4-41f9-a71d-5c05825f0065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:16.424821 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85baad5-86b4-41f9-a71d-5c05825f0065 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:16.425104 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85baad5-86b4-41f9-a71d-5c05825f0065 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:16.425381 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85baad5-86b4-41f9-a71d-5c05825f0065 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:16.426049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85baad5-86b4-41f9-a71d-5c05825f0065 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:16.426357 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85baad5-86b4-41f9-a71d-5c05825f0065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:16.427771 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85baad5-86b4-41f9-a71d-5c05825f0065 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:16.437368 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 362/715] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:16.443569 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a9a9a-a191-4fe9-a4a1-a748f06e0075 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:16.549888 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:16.554720 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a9a9a-a191-4fe9-a4a1-a748f06e0075 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:16.592731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc280ad5-b598-43b6-b7e4-b7eab4257755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:16.593445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc280ad5-b598-43b6-b7e4-b7eab4257755 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:16.593797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc280ad5-b598-43b6-b7e4-b7eab4257755 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:16.594322 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc280ad5-b598-43b6-b7e4-b7eab4257755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:16.606639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc280ad5-b598-43b6-b7e4-b7eab4257755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:16.608239 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc280ad5-b598-43b6-b7e4-b7eab4257755 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-cc280ad5-b598-43b6-b7e4-b7eab4257755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:16.625557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:16.626555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:16.627511 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:16.627511 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:16.627511 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:16.627511 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 354/716] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:16.633978 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85baad5-86b4-41f9-a71d-5c05825f0065 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:16.744174 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85baad5-86b4-41f9-a71d-5c05825f0065 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:16.785050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912e12e-a359-4322-9826-0b65dfccabc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:16.785664 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e12e-a359-4322-9826-0b65dfccabc2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:16.785948 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e12e-a359-4322-9826-0b65dfccabc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:16.786225 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e12e-a359-4322-9826-0b65dfccabc2 None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:16.787486 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912e12e-a359-4322-9826-0b65dfccabc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:16.787795 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912e12e-a359-4322-9826-0b65dfccabc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:16.789278 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912e12e-a359-4322-9826-0b65dfccabc2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:16.802596 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 363/717] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:16.808321 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc280ad5-b598-43b6-b7e4-b7eab4257755 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:16.919094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc280ad5-b598-43b6-b7e4-b7eab4257755 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:16.955688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3ffc3-3112-43f6-b7ca-158b57a94d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:16.956353 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3ffc3-3112-43f6-b7ca-158b57a94d76 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:16.956635 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3ffc3-3112-43f6-b7ca-158b57a94d76 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:16.956909 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3ffc3-3112-43f6-b7ca-158b57a94d76 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:16.965088 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3ffc3-3112-43f6-b7ca-158b57a94d76 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:16.966535 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3ffc3-3112-43f6-b7ca-158b57a94d76 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-04e3ffc3-3112-43f6-b7ca-158b57a94d76 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:16.978915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:16.981096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:16.983311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:16.983311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:16.983311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:16.983311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:16.983311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:16.983311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:16.983311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:16.983311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:16.983311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 22:08:16.983311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:16.983311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 355/718] 10.222.0.58 () {56 vars in 1093 bytes} [Tue Aug 23 22:08:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:16.987852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912e12e-a359-4322-9826-0b65dfccabc2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:17.012966 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:17.094793 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912e12e-a359-4322-9826-0b65dfccabc2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:17.132719 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703a752-2d4e-457b-8e4e-6c5aa6569e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:17.133578 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a752-2d4e-457b-8e4e-6c5aa6569e3d None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.134026 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a752-2d4e-457b-8e4e-6c5aa6569e3d None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.134432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a752-2d4e-457b-8e4e-6c5aa6569e3d None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.135291 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703a752-2d4e-457b-8e4e-6c5aa6569e3d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:17.135739 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703a752-2d4e-457b-8e4e-6c5aa6569e3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:17.137348 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703a752-2d4e-457b-8e4e-6c5aa6569e3d None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:17.157700 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 364/719] 10.222.0.58 () {56 vars in 1133 bytes} [Tue Aug 23 22:08:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:17.164080 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3ffc3-3112-43f6-b7ca-158b57a94d76 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:17.178117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:17.280506 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3ffc3-3112-43f6-b7ca-158b57a94d76 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:17.320473 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8026ffa-ef44-4a36-b7c0-750a984bf9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:17.321088 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8026ffa-ef44-4a36-b7c0-750a984bf9b2 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.321372 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8026ffa-ef44-4a36-b7c0-750a984bf9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.321711 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8026ffa-ef44-4a36-b7c0-750a984bf9b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.400652 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8026ffa-ef44-4a36-b7c0-750a984bf9b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:17.402116 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8026ffa-ef44-4a36-b7c0-750a984bf9b2 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:17.414968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:17.520095 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 356/720] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:17 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:08:17.522641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703a752-2d4e-457b-8e4e-6c5aa6569e3d None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:17.609883 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:17.636215 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703a752-2d4e-457b-8e4e-6c5aa6569e3d None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:17.674066 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2586396-e182-44db-84dd-b17c0f84648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:17.674975 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586396-e182-44db-84dd-b17c0f84648a None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.675403 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586396-e182-44db-84dd-b17c0f84648a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.675824 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2586396-e182-44db-84dd-b17c0f84648a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.687098 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2586396-e182-44db-84dd-b17c0f84648a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:17.688737 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2586396-e182-44db-84dd-b17c0f84648a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-a2586396-e182-44db-84dd-b17c0f84648a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:17.705057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:17.706194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:17.707291 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:17.707291 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:17.707291 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:17.709357 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 365/721] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:17.716922 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8026ffa-ef44-4a36-b7c0-750a984bf9b2 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:17.788881 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c61057-ef7a-485a-99ec-c51384c523f3 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.789211 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c61057-ef7a-485a-99ec-c51384c523f3 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.789513 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c61057-ef7a-485a-99ec-c51384c523f3 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.791499 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 366/722] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:17.797365 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57241f3-d95b-451c-a351-19704b00175b None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.797645 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57241f3-d95b-451c-a351-19704b00175b None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.797916 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57241f3-d95b-451c-a351-19704b00175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.823703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-d57241f3-d95b-451c-a351-19704b00175b None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:17.825025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-d57241f3-d95b-451c-a351-19704b00175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:17.831641 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8026ffa-ef44-4a36-b7c0-750a984bf9b2 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:17.843202 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:17.869638 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11258-5d63-46a2-a64b-f4e88b322e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:17.870409 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11258-5d63-46a2-a64b-f4e88b322e31 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:17.870739 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11258-5d63-46a2-a64b-f4e88b322e31 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:17.871080 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11258-5d63-46a2-a64b-f4e88b322e31 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:17.871781 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d11258-5d63-46a2-a64b-f4e88b322e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:17.872174 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d11258-5d63-46a2-a64b-f4e88b322e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:17.873603 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d11258-5d63-46a2-a64b-f4e88b322e31 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:17.886649 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 357/723] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:17.892582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11258-5d63-46a2-a64b-f4e88b322e31 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:17.910000 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 367/724] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:17 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:18.005020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11258-5d63-46a2-a64b-f4e88b322e31 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:18.041331 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c331a2b-abc6-4052-8be2-bc3cc68605c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:18.041876 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c331a2b-abc6-4052-8be2-bc3cc68605c7 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.042153 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c331a2b-abc6-4052-8be2-bc3cc68605c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.042421 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c331a2b-abc6-4052-8be2-bc3cc68605c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.049514 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c331a2b-abc6-4052-8be2-bc3cc68605c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:18.050968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c331a2b-abc6-4052-8be2-bc3cc68605c7 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-6c331a2b-abc6-4052-8be2-bc3cc68605c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:18.063154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:18.064167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:18.065039 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:18.065039 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:18.065039 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:18.065039 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:18.065039 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:18.065039 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:18.065039 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:18.065039 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:18.065039 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 358/725] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:18.073058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57241f3-d95b-451c-a351-19704b00175b None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:18.139453 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:18.184067 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57241f3-d95b-451c-a351-19704b00175b None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:18.222180 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e16d7-53b0-4183-8846-ca4d9d0a5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:18.222800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e16d7-53b0-4183-8846-ca4d9d0a5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.223083 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e16d7-53b0-4183-8846-ca4d9d0a5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.223361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e16d7-53b0-4183-8846-ca4d9d0a5ec3 None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.224199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e16d7-53b0-4183-8846-ca4d9d0a5ec3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:18.224510 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e16d7-53b0-4183-8846-ca4d9d0a5ec3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:18.225957 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e16d7-53b0-4183-8846-ca4d9d0a5ec3 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:18.240350 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 368/726] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:18.248895 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c331a2b-abc6-4052-8be2-bc3cc68605c7 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:18.261455 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e16d7-53b0-4183-8846-ca4d9d0a5ec3 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:18.292838 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:18.391784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e16d7-53b0-4183-8846-ca4d9d0a5ec3 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:18.395999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c331a2b-abc6-4052-8be2-bc3cc68605c7 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:18.424845 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:18.439082 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98166b-e192-4b46-b5b9-c5cd7f234312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:18.439687 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98166b-e192-4b46-b5b9-c5cd7f234312 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.439995 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98166b-e192-4b46-b5b9-c5cd7f234312 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.440271 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98166b-e192-4b46-b5b9-c5cd7f234312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.440889 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b6403-1573-440d-991b-2d9858b99243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:18.441042 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98166b-e192-4b46-b5b9-c5cd7f234312 None admin] RBAC: Adding query filter params (role.id=81a7cb1c95fd45708dbee5e4dc91626b, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=d43a6040fd95466fa17acdb1f30476ab) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:18.441283 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98166b-e192-4b46-b5b9-c5cd7f234312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:18.442007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b6403-1573-440d-991b-2d9858b99243 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.442435 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b6403-1573-440d-991b-2d9858b99243 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.443328 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98166b-e192-4b46-b5b9-c5cd7f234312 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:18.443681 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b6403-1573-440d-991b-2d9858b99243 None admin] PATH_INFO: `/v3/services/image` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.444478 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b6403-1573-440d-991b-2d9858b99243 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:18.446109 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b6403-1573-440d-991b-2d9858b99243 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:18.454641 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 359/727] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:08:18 2022] GET /identity/v3/role_assignments?user.id=d43a6040fd95466fa17acdb1f30476ab&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=81a7cb1c95fd45708dbee5e4dc91626b => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-859b6403-1573-440d-991b-2d9858b99243 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:18.460553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:18.461758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:18.462632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 369/728] 10.222.0.58 () {56 vars in 1105 bytes} [Tue Aug 23 22:08:18 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:18.468007 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98166b-e192-4b46-b5b9-c5cd7f234312 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:18.546833 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093620d-4c39-48f5-a8f8-be6e142e2f21 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.547028 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093620d-4c39-48f5-a8f8-be6e142e2f21 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.547312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093620d-4c39-48f5-a8f8-be6e142e2f21 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.548988 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 370/729] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:18.555201 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3f1a8-280d-4dc4-b2c7-ffe37ab3d511 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.555502 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3f1a8-280d-4dc4-b2c7-ffe37ab3d511 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.555759 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3f1a8-280d-4dc4-b2c7-ffe37ab3d511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.575871 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:18.577609 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-58f3f1a8-280d-4dc4-b2c7-ffe37ab3d511 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:18.578928 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-58f3f1a8-280d-4dc4-b2c7-ffe37ab3d511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:18.584203 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98166b-e192-4b46-b5b9-c5cd7f234312 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:18.622191 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1df71-b3d4-4a26-ab82-5eddb95a6c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:18.622811 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1df71-b3d4-4a26-ab82-5eddb95a6c41 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.623089 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1df71-b3d4-4a26-ab82-5eddb95a6c41 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.623360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1df71-b3d4-4a26-ab82-5eddb95a6c41 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.624032 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1df71-b3d4-4a26-ab82-5eddb95a6c41 None admin] RBAC: Adding query filter params (name=image) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:18.624448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1df71-b3d4-4a26-ab82-5eddb95a6c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:18.626328 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1df71-b3d4-4a26-ab82-5eddb95a6c41 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:18.632855 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 360/730] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:18.633840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228370d-f405-4a7d-a055-96a78ffdd38e None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.634127 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228370d-f405-4a7d-a055-96a78ffdd38e None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.634401 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228370d-f405-4a7d-a055-96a78ffdd38e None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.640023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 361/731] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:18.640023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228370d-f405-4a7d-a055-96a78ffdd38e None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:18.673040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 371/732] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:18.674614 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37957ca7-af88-4ae9-9232-8c61fb0f9b51 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.675115 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37957ca7-af88-4ae9-9232-8c61fb0f9b51 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.675384 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37957ca7-af88-4ae9-9232-8c61fb0f9b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.695796 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-37957ca7-af88-4ae9-9232-8c61fb0f9b51 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:18.697089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-37957ca7-af88-4ae9-9232-8c61fb0f9b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:18.774307 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228370d-f405-4a7d-a055-96a78ffdd38e None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:18.794836 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 372/733] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:18.826460 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b089982-0bd0-4efd-9eee-22da2e121e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:18.827348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b089982-0bd0-4efd-9eee-22da2e121e05 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.827796 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b089982-0bd0-4efd-9eee-22da2e121e05 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.828236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b089982-0bd0-4efd-9eee-22da2e121e05 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.829012 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b089982-0bd0-4efd-9eee-22da2e121e05 None admin] RBAC: Adding query filter params (type=image) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:18.829450 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b089982-0bd0-4efd-9eee-22da2e121e05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:18.831061 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b089982-0bd0-4efd-9eee-22da2e121e05 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:18.837515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 362/734] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:18.845433 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37957ca7-af88-4ae9-9232-8c61fb0f9b51 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:18.893766 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:18.950442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37957ca7-af88-4ae9-9232-8c61fb0f9b51 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:18.991088 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e154dcf-f0bd-466a-a051-b8a601736ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:18.991709 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e154dcf-f0bd-466a-a051-b8a601736ac2 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:18.992028 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e154dcf-f0bd-466a-a051-b8a601736ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:18.992303 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e154dcf-f0bd-466a-a051-b8a601736ac2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:18.992996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e154dcf-f0bd-466a-a051-b8a601736ac2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:18.994374 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e154dcf-f0bd-466a-a051-b8a601736ac2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.021175 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 373/735] 10.222.0.58 () {60 vars in 1144 bytes} [Tue Aug 23 22:08:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:19.026940 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b089982-0bd0-4efd-9eee-22da2e121e05 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.069960 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:19.163485 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b089982-0bd0-4efd-9eee-22da2e121e05 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.206848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e154dcf-f0bd-466a-a051-b8a601736ac2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.215308 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8462c-3dc7-4c26-b34f-dacef9d08cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.216596 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8462c-3dc7-4c26-b34f-dacef9d08cf8 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.216596 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8462c-3dc7-4c26-b34f-dacef9d08cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.216596 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8462c-3dc7-4c26-b34f-dacef9d08cf8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.217086 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8462c-3dc7-4c26-b34f-dacef9d08cf8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.218463 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8462c-3dc7-4c26-b34f-dacef9d08cf8 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-4eb8462c-3dc7-4c26-b34f-dacef9d08cf8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:19.228875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:19.229924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:19.230755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 363/736] 10.222.0.58 () {56 vars in 1129 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:19.235996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8462c-3dc7-4c26-b34f-dacef9d08cf8 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.330890 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e154dcf-f0bd-466a-a051-b8a601736ac2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.332908 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:19.339329 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:19.362106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8462c-3dc7-4c26-b34f-dacef9d08cf8 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.382538 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7edb1-957e-4a5c-8284-81803b6e8671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.383871 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7edb1-957e-4a5c-8284-81803b6e8671 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.384368 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7edb1-957e-4a5c-8284-81803b6e8671 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.384834 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7edb1-957e-4a5c-8284-81803b6e8671 None admin] PATH_INFO: `/v3/services/network` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.385598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7edb1-957e-4a5c-8284-81803b6e8671 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.388130 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7edb1-957e-4a5c-8284-81803b6e8671 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-61a7edb1-957e-4a5c-8284-81803b6e8671 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:19.400816 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:19.401828 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 22:08:19.402670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:19.403405 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3286d5-065b-42f6-aa74-afadf66c62a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.403405 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3286d5-065b-42f6-aa74-afadf66c62a2 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.403405 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3286d5-065b-42f6-aa74-afadf66c62a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.403405 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3286d5-065b-42f6-aa74-afadf66c62a2 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.403685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3286d5-065b-42f6-aa74-afadf66c62a2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:19.404586 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3286d5-065b-42f6-aa74-afadf66c62a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.406079 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3286d5-065b-42f6-aa74-afadf66c62a2 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.406270 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 374/737] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:19.412338 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7edb1-957e-4a5c-8284-81803b6e8671 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.412477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 364/738] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:19.417715 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3286d5-065b-42f6-aa74-afadf66c62a2 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.537294 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7edb1-957e-4a5c-8284-81803b6e8671 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.543363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3286d5-065b-42f6-aa74-afadf66c62a2 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.581944 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011670a3-4ae4-42fd-914e-2022f8353f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.582559 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011670a3-4ae4-42fd-914e-2022f8353f36 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.582839 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011670a3-4ae4-42fd-914e-2022f8353f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.583112 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011670a3-4ae4-42fd-914e-2022f8353f36 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.584905 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011670a3-4ae4-42fd-914e-2022f8353f36 None admin] RBAC: Adding query filter params (name=network) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:19.585109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a1301-fa26-4bac-a9d7-cd441207ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.585206 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011670a3-4ae4-42fd-914e-2022f8353f36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.585603 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a1301-fa26-4bac-a9d7-cd441207ad92 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.585888 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a1301-fa26-4bac-a9d7-cd441207ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.586163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a1301-fa26-4bac-a9d7-cd441207ad92 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.586583 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011670a3-4ae4-42fd-914e-2022f8353f36 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.587261 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a1301-fa26-4bac-a9d7-cd441207ad92 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:19.587576 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a1301-fa26-4bac-a9d7-cd441207ad92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.588973 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a1301-fa26-4bac-a9d7-cd441207ad92 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.592437 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 375/739] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:19.598577 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011670a3-4ae4-42fd-914e-2022f8353f36 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.601525 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 365/740] 10.222.0.58 () {56 vars in 1124 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:19.607401 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a1301-fa26-4bac-a9d7-cd441207ad92 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.626097 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:19.641440 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:19.727367 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011670a3-4ae4-42fd-914e-2022f8353f36 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.742443 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a1301-fa26-4bac-a9d7-cd441207ad92 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.763262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c33054-0195-430a-9db6-39c16dbd1c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.763987 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c33054-0195-430a-9db6-39c16dbd1c5c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.764360 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c33054-0195-430a-9db6-39c16dbd1c5c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.764701 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c33054-0195-430a-9db6-39c16dbd1c5c None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.765392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c33054-0195-430a-9db6-39c16dbd1c5c None admin] RBAC: Adding query filter params (type=network) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:19.765760 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c33054-0195-430a-9db6-39c16dbd1c5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.767250 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c33054-0195-430a-9db6-39c16dbd1c5c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.777694 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 376/741] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:19.779155 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c33054-0195-430a-9db6-39c16dbd1c5c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:19.781301 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bee9a0-7a24-4ad4-bea4-4c876303f94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.782023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bee9a0-7a24-4ad4-bea4-4c876303f94c None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.782313 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bee9a0-7a24-4ad4-bea4-4c876303f94c None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.782588 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bee9a0-7a24-4ad4-bea4-4c876303f94c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.783355 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bee9a0-7a24-4ad4-bea4-4c876303f94c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.784768 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bee9a0-7a24-4ad4-bea4-4c876303f94c None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:19.819354 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 366/742] 10.222.0.58 () {60 vars in 1144 bytes} [Tue Aug 23 22:08:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:08:19.913090 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:19.922452 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c33054-0195-430a-9db6-39c16dbd1c5c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:19.974899 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4f2df-c05d-4792-9010-bfcdb8b97677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:19.975676 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4f2df-c05d-4792-9010-bfcdb8b97677 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:19.976277 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4f2df-c05d-4792-9010-bfcdb8b97677 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:19.976775 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4f2df-c05d-4792-9010-bfcdb8b97677 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:19.978256 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4f2df-c05d-4792-9010-bfcdb8b97677 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:19.980826 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4f2df-c05d-4792-9010-bfcdb8b97677 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:20.009528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 377/743] 10.222.0.58 () {60 vars in 1144 bytes} [Tue Aug 23 22:08:19 2022] POST /identity/v3/endpoints => generated 337 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:20.858149 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440be8c-226b-4185-8beb-0f016713aab2 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:20.858720 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440be8c-226b-4185-8beb-0f016713aab2 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:20.858720 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440be8c-226b-4185-8beb-0f016713aab2 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:20.860169 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 367/744] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:20.865947 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d09bbd-90d7-477f-ae31-65b7dd71504d None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:20.866344 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d09bbd-90d7-477f-ae31-65b7dd71504d None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:20.866525 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d09bbd-90d7-477f-ae31-65b7dd71504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:20.884722 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-15d09bbd-90d7-477f-ae31-65b7dd71504d None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:20.885893 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-15d09bbd-90d7-477f-ae31-65b7dd71504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:20.960173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 378/745] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:20 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:21.282835 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440be8c-226b-4185-8beb-0f016713aab2 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:21.359610 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:21.399035 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440be8c-226b-4185-8beb-0f016713aab2 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:21.441516 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ec339-a973-4911-a983-fe8e943e5c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:21.443080 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ec339-a973-4911-a983-fe8e943e5c66 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:21.443851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ec339-a973-4911-a983-fe8e943e5c66 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:21.444337 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ec339-a973-4911-a983-fe8e943e5c66 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:21.445138 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ec339-a973-4911-a983-fe8e943e5c66 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:21.446732 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ec339-a973-4911-a983-fe8e943e5c66 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-3a5ec339-a973-4911-a983-fe8e943e5c66 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:21.456026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:21.456966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:08:21.457851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:21.460417 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 368/746] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Aug 23 22:08:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:21.465708 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d09bbd-90d7-477f-ae31-65b7dd71504d None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:21.495692 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2f4e6-99b2-4c0f-97d3-8c3fcdff2607 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:21.495959 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2f4e6-99b2-4c0f-97d3-8c3fcdff2607 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:21.496240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2f4e6-99b2-4c0f-97d3-8c3fcdff2607 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:21.497558 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 369/747] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:21.502794 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873d699-e48b-46ee-a03c-fa59886a8fdb None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:21.503083 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873d699-e48b-46ee-a03c-fa59886a8fdb None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:21.503362 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873d699-e48b-46ee-a03c-fa59886a8fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:21.523256 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-5873d699-e48b-46ee-a03c-fa59886a8fdb None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:21.524882 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-5873d699-e48b-46ee-a03c-fa59886a8fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:21.545152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:21.578124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d09bbd-90d7-477f-ae31-65b7dd71504d None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:21.604370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 370/748] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:21 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:08:21.618867 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbffdef-9536-4d41-bc3c-85c18c86dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:21.619554 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbffdef-9536-4d41-bc3c-85c18c86dd3e None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:21.619940 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbffdef-9536-4d41-bc3c-85c18c86dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:21.620290 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbffdef-9536-4d41-bc3c-85c18c86dd3e None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:21.620997 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbffdef-9536-4d41-bc3c-85c18c86dd3e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:21.621368 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbffdef-9536-4d41-bc3c-85c18c86dd3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:21.622814 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbffdef-9536-4d41-bc3c-85c18c86dd3e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:21.627776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 379/749] 10.222.0.58 () {56 vars in 1126 bytes} [Tue Aug 23 22:08:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:21.633847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873d699-e48b-46ee-a03c-fa59886a8fdb None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:21.695786 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:21.741900 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873d699-e48b-46ee-a03c-fa59886a8fdb None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:21.776525 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28bff8-63a4-41cf-9282-7b6a24c5df84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:21.777061 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28bff8-63a4-41cf-9282-7b6a24c5df84 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:21.777342 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28bff8-63a4-41cf-9282-7b6a24c5df84 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:21.777612 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28bff8-63a4-41cf-9282-7b6a24c5df84 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:21.778243 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28bff8-63a4-41cf-9282-7b6a24c5df84 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:21.778546 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28bff8-63a4-41cf-9282-7b6a24c5df84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:21.779934 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28bff8-63a4-41cf-9282-7b6a24c5df84 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:21.784527 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 371/750] 10.222.0.58 () {56 vars in 1126 bytes} [Tue Aug 23 22:08:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:21.932153 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbffdef-9536-4d41-bc3c-85c18c86dd3e None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:22.044323 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbffdef-9536-4d41-bc3c-85c18c86dd3e None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:22.078071 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cd6ef-0396-46bc-ad7b-b21328f9b741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:22.078678 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd6ef-0396-46bc-ad7b-b21328f9b741 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:22.078964 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd6ef-0396-46bc-ad7b-b21328f9b741 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:22.079240 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cd6ef-0396-46bc-ad7b-b21328f9b741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:22.082720 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:22.151319 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cd6ef-0396-46bc-ad7b-b21328f9b741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:22.152806 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953cd6ef-0396-46bc-ad7b-b21328f9b741 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:22.166018 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190920be-3b8d-4ffb-93dd-707387f30188 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:22.166551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190920be-3b8d-4ffb-93dd-707387f30188 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:22.166551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190920be-3b8d-4ffb-93dd-707387f30188 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:22.168034 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 372/751] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:08:22.172927 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dae2ee-0ff3-4443-9062-d8f38e2e2e7b None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:22.173215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dae2ee-0ff3-4443-9062-d8f38e2e2e7b None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:22.173486 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dae2ee-0ff3-4443-9062-d8f38e2e2e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:22.191714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-69dae2ee-0ff3-4443-9062-d8f38e2e2e7b None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:22.193529 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-69dae2ee-0ff3-4443-9062-d8f38e2e2e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:22.263860 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 380/752] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:08:21 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:08:22.269480 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cd6ef-0396-46bc-ad7b-b21328f9b741 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:22.271003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 373/753] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:22 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:08:22.304562 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:22.373029 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953cd6ef-0396-46bc-ad7b-b21328f9b741 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:22.406983 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8fbf3-0120-4252-b248-83f6931aed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:22.407605 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8fbf3-0120-4252-b248-83f6931aed5c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:22.407914 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8fbf3-0120-4252-b248-83f6931aed5c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:22.408190 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8fbf3-0120-4252-b248-83f6931aed5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:22.419014 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8fbf3-0120-4252-b248-83f6931aed5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:22.420503 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8fbf3-0120-4252-b248-83f6931aed5c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-b5f8fbf3-0120-4252-b248-83f6931aed5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:08:22.435592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:22.436689 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:08:22.437659 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:08:22.437659 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:08:22.437659 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:22.440134 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 381/754] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:22.442595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dae2ee-0ff3-4443-9062-d8f38e2e2e7b None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:22.502940 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:22.549639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dae2ee-0ff3-4443-9062-d8f38e2e2e7b None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:22.584135 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bc5fe-d0ce-4efd-87ab-789d73101fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:22.584717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bc5fe-d0ce-4efd-87ab-789d73101fe3 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:22.585004 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bc5fe-d0ce-4efd-87ab-789d73101fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:22.585283 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bc5fe-d0ce-4efd-87ab-789d73101fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:22.585922 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bc5fe-d0ce-4efd-87ab-789d73101fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:22.586228 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bc5fe-d0ce-4efd-87ab-789d73101fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:22.587601 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bc5fe-d0ce-4efd-87ab-789d73101fe3 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:22.607856 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 374/755] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:22.608077 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8fbf3-0120-4252-b248-83f6931aed5c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:22.710075 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:22.725263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8fbf3-0120-4252-b248-83f6931aed5c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:22.761732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2509cf1-c8ca-447b-97f6-bbcbc1c75cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:22.762379 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2509cf1-c8ca-447b-97f6-bbcbc1c75cba None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:22.762662 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2509cf1-c8ca-447b-97f6-bbcbc1c75cba None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:22.762939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2509cf1-c8ca-447b-97f6-bbcbc1c75cba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:22.763528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2509cf1-c8ca-447b-97f6-bbcbc1c75cba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:22.764958 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2509cf1-c8ca-447b-97f6-bbcbc1c75cba None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-e2509cf1-c8ca-447b-97f6-bbcbc1c75cba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:22.774939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:22.776327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:22.780853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 382/756] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:22.782885 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bc5fe-d0ce-4efd-87ab-789d73101fe3 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:22.905624 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bc5fe-d0ce-4efd-87ab-789d73101fe3 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:22.922651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:22.946120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd654265-7d26-4d46-8c21-1575fab3e32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:22.946925 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd654265-7d26-4d46-8c21-1575fab3e32c None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:22.947285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd654265-7d26-4d46-8c21-1575fab3e32c None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:22.947634 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd654265-7d26-4d46-8c21-1575fab3e32c None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:22.948395 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd654265-7d26-4d46-8c21-1575fab3e32c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:22.948769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd654265-7d26-4d46-8c21-1575fab3e32c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:22.950205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd654265-7d26-4d46-8c21-1575fab3e32c None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:22.955444 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 375/757] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:22.961950 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2509cf1-c8ca-447b-97f6-bbcbc1c75cba None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:23.058908 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2509cf1-c8ca-447b-97f6-bbcbc1c75cba None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:23.092139 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b93a1-e057-4907-872b-31637e3da455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:23.092730 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b93a1-e057-4907-872b-31637e3da455 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:23.093007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b93a1-e057-4907-872b-31637e3da455 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:23.093274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b93a1-e057-4907-872b-31637e3da455 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:23.094136 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b93a1-e057-4907-872b-31637e3da455 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:23.094436 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b93a1-e057-4907-872b-31637e3da455 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:23.095790 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06b93a1-e057-4907-872b-31637e3da455 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:23.100090 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 383/758] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:24.014694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b64348-9c63-4780-bed8-b7fba5d3df51 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:24.015263 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b64348-9c63-4780-bed8-b7fba5d3df51 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:24.015263 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b64348-9c63-4780-bed8-b7fba5d3df51 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:24.016664 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 376/759] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:24.022523 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ee81-5d8d-422f-8a42-17cd5c5fde54 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:24.022926 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ee81-5d8d-422f-8a42-17cd5c5fde54 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:24.023061 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ee81-5d8d-422f-8a42-17cd5c5fde54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:24.040598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-0da8ee81-5d8d-422f-8a42-17cd5c5fde54 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:24.041770 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-0da8ee81-5d8d-422f-8a42-17cd5c5fde54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:24.052833 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:24.108054 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 384/760] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:24 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:24.432911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b64348-9c63-4780-bed8-b7fba5d3df51 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:24.535800 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b64348-9c63-4780-bed8-b7fba5d3df51 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:24.570003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f64c86-074c-4d0e-924d-03209a4f6d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:24.570603 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f64c86-074c-4d0e-924d-03209a4f6d52 None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:24.570881 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f64c86-074c-4d0e-924d-03209a4f6d52 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:24.571153 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f64c86-074c-4d0e-924d-03209a4f6d52 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:24.571784 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f64c86-074c-4d0e-924d-03209a4f6d52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:24.573245 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f64c86-074c-4d0e-924d-03209a4f6d52 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:24.587251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 377/761] 10.222.0.58 () {60 vars in 1141 bytes} [Tue Aug 23 22:08:24 2022] POST /identity/v3/services => generated 269 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:08:25.299120 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f16a6-dcab-4e82-bee0-fc7ad4cf7345 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:25.299665 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f16a6-dcab-4e82-bee0-fc7ad4cf7345 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:25.299748 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f16a6-dcab-4e82-bee0-fc7ad4cf7345 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:25.301071 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 385/762] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:25.307000 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d449-4710-49d5-9ee4-a340558be4f6 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:25.307422 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d449-4710-49d5-9ee4-a340558be4f6 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:25.307545 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8d449-4710-49d5-9ee4-a340558be4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:25.325543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-dff8d449-4710-49d5-9ee4-a340558be4f6 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:25.326711 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-dff8d449-4710-49d5-9ee4-a340558be4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:25.357422 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:25.400154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 378/763] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:25 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:25.725597 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f16a6-dcab-4e82-bee0-fc7ad4cf7345 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:25.825323 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f16a6-dcab-4e82-bee0-fc7ad4cf7345 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:25.859958 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ef2ca-d17f-42a1-bb29-d0f2d64feec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:25.860592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ef2ca-d17f-42a1-bb29-d0f2d64feec3 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:25.860878 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ef2ca-d17f-42a1-bb29-d0f2d64feec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:25.861154 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ef2ca-d17f-42a1-bb29-d0f2d64feec3 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:25.861792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ef2ca-d17f-42a1-bb29-d0f2d64feec3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:25.863163 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ef2ca-d17f-42a1-bb29-d0f2d64feec3 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:25.878936 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 386/764] 10.222.0.58 () {60 vars in 1141 bytes} [Tue Aug 23 22:08:25 2022] POST /identity/v3/services => generated 251 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:08:26.803811 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19828a-c34c-47a8-973e-de4ed1e30eaf None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:26.804371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19828a-c34c-47a8-973e-de4ed1e30eaf None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:26.804371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19828a-c34c-47a8-973e-de4ed1e30eaf None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:26.805696 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 379/765] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:26.811037 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3b72-6480-4028-83da-0a36a0cc5752 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:26.811458 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3b72-6480-4028-83da-0a36a0cc5752 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:26.811590 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3b72-6480-4028-83da-0a36a0cc5752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:26.825089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:26.830530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-b30d3b72-6480-4028-83da-0a36a0cc5752 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:26.832084 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-b30d3b72-6480-4028-83da-0a36a0cc5752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:26.914949 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 387/766] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:26 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:27.242341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19828a-c34c-47a8-973e-de4ed1e30eaf None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:27.343232 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19828a-c34c-47a8-973e-de4ed1e30eaf None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:27.377571 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284fd29-27a1-4e99-b5ae-66f405a614f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:27.378186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284fd29-27a1-4e99-b5ae-66f405a614f3 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:27.378461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284fd29-27a1-4e99-b5ae-66f405a614f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:27.378726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284fd29-27a1-4e99-b5ae-66f405a614f3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:27.379295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284fd29-27a1-4e99-b5ae-66f405a614f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:27.381581 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284fd29-27a1-4e99-b5ae-66f405a614f3 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-f284fd29-27a1-4e99-b5ae-66f405a614f3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:27.389964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:27.391028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:27.392022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 380/767] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Aug 23 22:08:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:27.397148 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3b72-6480-4028-83da-0a36a0cc5752 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:27.496344 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3b72-6480-4028-83da-0a36a0cc5752 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:27.525043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:27.530788 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e122-e4b7-4088-8fb6-09ad63232860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:27.531391 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e122-e4b7-4088-8fb6-09ad63232860 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:27.531671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e122-e4b7-4088-8fb6-09ad63232860 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:27.531974 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e122-e4b7-4088-8fb6-09ad63232860 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:27.532598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056e122-e4b7-4088-8fb6-09ad63232860 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:27.532897 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056e122-e4b7-4088-8fb6-09ad63232860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:27.534260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056e122-e4b7-4088-8fb6-09ad63232860 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:27.539729 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 388/768] 10.222.0.58 () {56 vars in 1126 bytes} [Tue Aug 23 22:08:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:27.545522 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284fd29-27a1-4e99-b5ae-66f405a614f3 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:27.574290 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:27.647646 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284fd29-27a1-4e99-b5ae-66f405a614f3 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:27.682059 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0caf0-59a7-413b-87ac-792e53e752f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:27.682669 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0caf0-59a7-413b-87ac-792e53e752f1 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:27.682951 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0caf0-59a7-413b-87ac-792e53e752f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:27.683222 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0caf0-59a7-413b-87ac-792e53e752f1 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:27.683859 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0caf0-59a7-413b-87ac-792e53e752f1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:27.684172 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0caf0-59a7-413b-87ac-792e53e752f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:27.685537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0caf0-59a7-413b-87ac-792e53e752f1 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:27.695881 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 381/769] 10.222.0.58 () {56 vars in 1126 bytes} [Tue Aug 23 22:08:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:27.697374 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e122-e4b7-4088-8fb6-09ad63232860 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:27.797532 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e122-e4b7-4088-8fb6-09ad63232860 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:27.831974 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec7b7b-5025-49d6-8233-a2c1ada4a08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:27.832641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec7b7b-5025-49d6-8233-a2c1ada4a08f None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:27.832852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec7b7b-5025-49d6-8233-a2c1ada4a08f None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:27.833239 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec7b7b-5025-49d6-8233-a2c1ada4a08f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:27.833939 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec7b7b-5025-49d6-8233-a2c1ada4a08f None admin] RBAC: Adding query filter params (interface=public, service_id=61234915a2064ce08acf7fad360b23d7, region_id=RegionOne) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:27.834253 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec7b7b-5025-49d6-8233-a2c1ada4a08f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:27.835635 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec7b7b-5025-49d6-8233-a2c1ada4a08f None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:27.840706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 389/770] 10.222.0.58 () {56 vars in 1251 bytes} [Tue Aug 23 22:08:27 2022] GET /identity/v3/endpoints?service_id=61234915a2064ce08acf7fad360b23d7&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:27.846602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0caf0-59a7-413b-87ac-792e53e752f1 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:27.947660 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:27.956906 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0caf0-59a7-413b-87ac-792e53e752f1 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:27.991543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b2bee-ba7d-478b-8038-04f726107851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:27.992186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b2bee-ba7d-478b-8038-04f726107851 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:27.992468 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b2bee-ba7d-478b-8038-04f726107851 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:27.992742 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b2bee-ba7d-478b-8038-04f726107851 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:27.993340 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b2bee-ba7d-478b-8038-04f726107851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:27.994709 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b2bee-ba7d-478b-8038-04f726107851 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:28.000878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 382/771] 10.222.0.58 () {56 vars in 1087 bytes} [Tue Aug 23 22:08:27 2022] GET /identity/v3/services => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:08:28.079236 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7d52-4e52-4c81-ac65-3e916af8602a None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:28.079444 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7d52-4e52-4c81-ac65-3e916af8602a None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:28.079697 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7d52-4e52-4c81-ac65-3e916af8602a None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:28.081074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 390/772] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:28.087371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34783874-fde2-4cde-bd29-40581d1f31e6 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:28.087659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34783874-fde2-4cde-bd29-40581d1f31e6 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:28.087972 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34783874-fde2-4cde-bd29-40581d1f31e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:28.107255 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-34783874-fde2-4cde-bd29-40581d1f31e6 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:28.108484 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-34783874-fde2-4cde-bd29-40581d1f31e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:28.179587 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 383/773] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:28 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:28.511668 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7d52-4e52-4c81-ac65-3e916af8602a None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:28.571908 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:28.616216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7d52-4e52-4c81-ac65-3e916af8602a None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:28.649596 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b528b-2720-486b-ac1c-d404fc6d1dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:28.650221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b528b-2720-486b-ac1c-d404fc6d1dca None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:28.650498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b528b-2720-486b-ac1c-d404fc6d1dca None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:28.650768 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b528b-2720-486b-ac1c-d404fc6d1dca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:28.651346 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b528b-2720-486b-ac1c-d404fc6d1dca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:28.652747 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b528b-2720-486b-ac1c-d404fc6d1dca None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-f44b528b-2720-486b-ac1c-d404fc6d1dca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:28.661347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:28.662487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:28.663321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 391/774] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:28.668320 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34783874-fde2-4cde-bd29-40581d1f31e6 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:28.751299 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:28.766908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34783874-fde2-4cde-bd29-40581d1f31e6 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:28.800109 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0420d-b10b-4b94-bb64-c93f32e5b7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:28.800704 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0420d-b10b-4b94-bb64-c93f32e5b7b1 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:28.800979 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0420d-b10b-4b94-bb64-c93f32e5b7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:28.801250 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0420d-b10b-4b94-bb64-c93f32e5b7b1 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:28.802404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0420d-b10b-4b94-bb64-c93f32e5b7b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:28.802693 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0420d-b10b-4b94-bb64-c93f32e5b7b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:28.804079 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0420d-b10b-4b94-bb64-c93f32e5b7b1 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:28.808616 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 384/775] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:28.814369 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b528b-2720-486b-ac1c-d404fc6d1dca None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:28.918436 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b528b-2720-486b-ac1c-d404fc6d1dca None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:28.944539 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:28.955192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f24baa-d3bd-48d3-86b3-e16ca667b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:28.955792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f24baa-d3bd-48d3-86b3-e16ca667b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:28.956122 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f24baa-d3bd-48d3-86b3-e16ca667b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:28.956395 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f24baa-d3bd-48d3-86b3-e16ca667b8e3 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:28.957018 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f24baa-d3bd-48d3-86b3-e16ca667b8e3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:28.957321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f24baa-d3bd-48d3-86b3-e16ca667b8e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:28.958733 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f24baa-d3bd-48d3-86b3-e16ca667b8e3 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:28.963419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 392/776] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:28.969927 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0420d-b10b-4b94-bb64-c93f32e5b7b1 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:29.072746 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0420d-b10b-4b94-bb64-c93f32e5b7b1 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:29.107595 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73418c7-c69c-42e1-a89e-937d6be92405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:29.108239 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73418c7-c69c-42e1-a89e-937d6be92405 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:29.108520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73418c7-c69c-42e1-a89e-937d6be92405 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:29.108791 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73418c7-c69c-42e1-a89e-937d6be92405 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:29.109501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73418c7-c69c-42e1-a89e-937d6be92405 None admin] RBAC: Adding query filter params (interface=public, service_id=74019e34a4ad47538a54c3cafcbbdd87, region_id=RegionOne) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:29.109808 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73418c7-c69c-42e1-a89e-937d6be92405 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:29.111187 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73418c7-c69c-42e1-a89e-937d6be92405 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:29.117764 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 385/777] 10.222.0.58 () {56 vars in 1251 bytes} [Tue Aug 23 22:08:28 2022] GET /identity/v3/endpoints?service_id=74019e34a4ad47538a54c3cafcbbdd87&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:29.123481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f24baa-d3bd-48d3-86b3-e16ca667b8e3 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:29.222969 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f24baa-d3bd-48d3-86b3-e16ca667b8e3 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:29.258306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f8664-1fea-47c6-988c-ea171c6fae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:29.258910 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f8664-1fea-47c6-988c-ea171c6fae2e None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:29.259188 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f8664-1fea-47c6-988c-ea171c6fae2e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:29.259458 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f8664-1fea-47c6-988c-ea171c6fae2e None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:29.260079 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f8664-1fea-47c6-988c-ea171c6fae2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:29.261444 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f8664-1fea-47c6-988c-ea171c6fae2e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:29.267356 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 393/778] 10.222.0.58 () {56 vars in 1087 bytes} [Tue Aug 23 22:08:29 2022] GET /identity/v3/services => generated 1498 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:08:30.217177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a663f-bb81-4235-b696-7c961cd6e489 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:30.217731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a663f-bb81-4235-b696-7c961cd6e489 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:30.217731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a663f-bb81-4235-b696-7c961cd6e489 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:30.219453 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 386/779] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:30.224645 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1095-0531-4891-b2b8-1efaed85fe9e None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:30.225075 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1095-0531-4891-b2b8-1efaed85fe9e None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:30.225178 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a1095-0531-4891-b2b8-1efaed85fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:30.244754 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-d78a1095-0531-4891-b2b8-1efaed85fe9e None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:30.245942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-d78a1095-0531-4891-b2b8-1efaed85fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:30.292835 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:30.313599 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 394/780] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:30 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:30.643805 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a663f-bb81-4235-b696-7c961cd6e489 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:30.659493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:30.746963 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a663f-bb81-4235-b696-7c961cd6e489 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:30.781673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdefe61-5541-4539-816a-21875d73efda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:30.782293 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdefe61-5541-4539-816a-21875d73efda None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:30.782575 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdefe61-5541-4539-816a-21875d73efda None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:30.782847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdefe61-5541-4539-816a-21875d73efda None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:30.783417 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdefe61-5541-4539-816a-21875d73efda None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:30.784830 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdefe61-5541-4539-816a-21875d73efda None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-8bdefe61-5541-4539-816a-21875d73efda None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:30.793469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:30.794487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:30.795360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 387/781] 10.222.0.58 () {56 vars in 1132 bytes} [Tue Aug 23 22:08:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:30.800839 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a1095-0531-4891-b2b8-1efaed85fe9e None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:30.905265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a1095-0531-4891-b2b8-1efaed85fe9e None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:30.938751 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0279dec-8e00-4517-8dd2-355f14ab5209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:30.939356 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0279dec-8e00-4517-8dd2-355f14ab5209 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:30.939638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0279dec-8e00-4517-8dd2-355f14ab5209 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:30.939945 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0279dec-8e00-4517-8dd2-355f14ab5209 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:30.940578 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0279dec-8e00-4517-8dd2-355f14ab5209 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:30.940889 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0279dec-8e00-4517-8dd2-355f14ab5209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:30.942340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0279dec-8e00-4517-8dd2-355f14ab5209 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:30.947569 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 395/782] 10.222.0.58 () {56 vars in 1126 bytes} [Tue Aug 23 22:08:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:30.953349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdefe61-5541-4539-816a-21875d73efda None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:31.043624 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:31.065201 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdefe61-5541-4539-816a-21875d73efda None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:31.098627 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b92e6-402e-4457-8f70-a00af3010af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:31.099814 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b92e6-402e-4457-8f70-a00af3010af9 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:31.100128 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b92e6-402e-4457-8f70-a00af3010af9 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:31.100404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b92e6-402e-4457-8f70-a00af3010af9 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:31.101031 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b92e6-402e-4457-8f70-a00af3010af9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:31.101332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b92e6-402e-4457-8f70-a00af3010af9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:31.102709 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b92e6-402e-4457-8f70-a00af3010af9 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:31.107617 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 388/783] 10.222.0.58 () {56 vars in 1126 bytes} [Tue Aug 23 22:08:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:31.113518 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0279dec-8e00-4517-8dd2-355f14ab5209 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:31.159381 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:31.215291 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0279dec-8e00-4517-8dd2-355f14ab5209 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:31.250989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebc6bc-3aa1-47c3-bfc8-6dcecc4d83c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:31.251587 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebc6bc-3aa1-47c3-bfc8-6dcecc4d83c2 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:31.251881 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebc6bc-3aa1-47c3-bfc8-6dcecc4d83c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:31.252156 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebc6bc-3aa1-47c3-bfc8-6dcecc4d83c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:31.252806 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebc6bc-3aa1-47c3-bfc8-6dcecc4d83c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:31.254178 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebc6bc-3aa1-47c3-bfc8-6dcecc4d83c2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:31.274737 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 396/784] 10.222.0.58 () {60 vars in 1144 bytes} [Tue Aug 23 22:08:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:31.548858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107963cf-f7a2-4923-98a7-ab2da5183ca9 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:31.549404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107963cf-f7a2-4923-98a7-ab2da5183ca9 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:31.549404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107963cf-f7a2-4923-98a7-ab2da5183ca9 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:31.550705 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 389/785] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:31.557006 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d3293-09b5-461c-92f0-5e02e84d8258 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:31.557289 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d3293-09b5-461c-92f0-5e02e84d8258 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:31.557559 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d3293-09b5-461c-92f0-5e02e84d8258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:31.575740 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-b94d3293-09b5-461c-92f0-5e02e84d8258 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:31.576943 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-b94d3293-09b5-461c-92f0-5e02e84d8258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:31.650879 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 397/786] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:31 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:31.979761 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107963cf-f7a2-4923-98a7-ab2da5183ca9 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:32.077953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107963cf-f7a2-4923-98a7-ab2da5183ca9 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:32.111332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cc69d-f38f-4e37-a4c0-a6aac1a8b748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:32.111972 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cc69d-f38f-4e37-a4c0-a6aac1a8b748 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.112251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cc69d-f38f-4e37-a4c0-a6aac1a8b748 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.112520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cc69d-f38f-4e37-a4c0-a6aac1a8b748 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.113084 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cc69d-f38f-4e37-a4c0-a6aac1a8b748 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:32.115531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cc69d-f38f-4e37-a4c0-a6aac1a8b748 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-a44cc69d-f38f-4e37-a4c0-a6aac1a8b748 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:32.124081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:32.125023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:32.125858 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 390/787] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:32.131091 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d3293-09b5-461c-92f0-5e02e84d8258 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:32.158126 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:32.231891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d3293-09b5-461c-92f0-5e02e84d8258 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:32.268098 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9ffa4-f51f-4f5b-882c-ec36e45116e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:32.268768 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9ffa4-f51f-4f5b-882c-ec36e45116e2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.269045 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9ffa4-f51f-4f5b-882c-ec36e45116e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.269314 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9ffa4-f51f-4f5b-882c-ec36e45116e2 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.269963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9ffa4-f51f-4f5b-882c-ec36e45116e2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:32.270332 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9ffa4-f51f-4f5b-882c-ec36e45116e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:32.271812 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9ffa4-f51f-4f5b-882c-ec36e45116e2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:32.276468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 398/788] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:32.282126 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cc69d-f38f-4e37-a4c0-a6aac1a8b748 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:32.292596 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:32.385604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cc69d-f38f-4e37-a4c0-a6aac1a8b748 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:32.420841 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a827e8-ee01-427c-811e-f593e989de37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:32.421445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a827e8-ee01-427c-811e-f593e989de37 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.421724 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a827e8-ee01-427c-811e-f593e989de37 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.421996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a827e8-ee01-427c-811e-f593e989de37 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.422619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a827e8-ee01-427c-811e-f593e989de37 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:32.422919 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a827e8-ee01-427c-811e-f593e989de37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:32.424332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a827e8-ee01-427c-811e-f593e989de37 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:32.429706 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 391/789] 10.222.0.58 () {56 vars in 1114 bytes} [Tue Aug 23 22:08:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:32.435259 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9ffa4-f51f-4f5b-882c-ec36e45116e2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:32.524956 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:32.533920 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9ffa4-f51f-4f5b-882c-ec36e45116e2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:32.566674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91850c86-284d-4a3c-9f69-a6dff73b1e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:32.567943 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91850c86-284d-4a3c-9f69-a6dff73b1e5e None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:32.568230 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91850c86-284d-4a3c-9f69-a6dff73b1e5e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:32.568497 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91850c86-284d-4a3c-9f69-a6dff73b1e5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:32.569171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91850c86-284d-4a3c-9f69-a6dff73b1e5e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:32.570545 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91850c86-284d-4a3c-9f69-a6dff73b1e5e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:32.590557 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 399/790] 10.222.0.58 () {60 vars in 1144 bytes} [Tue Aug 23 22:08:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:33.498608 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30848a6-d60f-4c5f-a86c-171856ea75d4 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:33.499129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30848a6-d60f-4c5f-a86c-171856ea75d4 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:33.499129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30848a6-d60f-4c5f-a86c-171856ea75d4 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:33.500424 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 392/791] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:33.505989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b3ff-c4c4-4ad1-8d37-3ec778d7d39b None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:33.506398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b3ff-c4c4-4ad1-8d37-3ec778d7d39b None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:33.506565 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85b3ff-c4c4-4ad1-8d37-3ec778d7d39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:33.525047 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-3f85b3ff-c4c4-4ad1-8d37-3ec778d7d39b None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:33.526219 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-3f85b3ff-c4c4-4ad1-8d37-3ec778d7d39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:33.598204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 400/792] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:33 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:33.931147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30848a6-d60f-4c5f-a86c-171856ea75d4 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:34.001940 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:34.041164 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30848a6-d60f-4c5f-a86c-171856ea75d4 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:34.074871 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e793d15-d146-44af-9f20-7fcc8f7b46ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:34.075495 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e793d15-d146-44af-9f20-7fcc8f7b46ce None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:34.075778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e793d15-d146-44af-9f20-7fcc8f7b46ce None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:34.076081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e793d15-d146-44af-9f20-7fcc8f7b46ce None admin] PATH_INFO: `/v3/services/compute` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:34.076659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e793d15-d146-44af-9f20-7fcc8f7b46ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:34.078029 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e793d15-d146-44af-9f20-7fcc8f7b46ce None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-7e793d15-d146-44af-9f20-7fcc8f7b46ce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:34.087168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:34.088183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:34.089067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 393/793] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:34.094457 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85b3ff-c4c4-4ad1-8d37-3ec778d7d39b None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:34.169518 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:34.195873 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85b3ff-c4c4-4ad1-8d37-3ec778d7d39b None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:34.230743 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26510f4c-9895-4949-96c2-cecb18d74a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:34.231406 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26510f4c-9895-4949-96c2-cecb18d74a08 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:34.231685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26510f4c-9895-4949-96c2-cecb18d74a08 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:34.231985 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26510f4c-9895-4949-96c2-cecb18d74a08 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:34.232572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26510f4c-9895-4949-96c2-cecb18d74a08 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:34.232878 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26510f4c-9895-4949-96c2-cecb18d74a08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:34.234259 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26510f4c-9895-4949-96c2-cecb18d74a08 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:34.240387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 401/794] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:34.246028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e793d15-d146-44af-9f20-7fcc8f7b46ce None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:34.347556 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e793d15-d146-44af-9f20-7fcc8f7b46ce None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:34.381703 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526758a7-3ae9-4942-bd20-165dcf9794ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:34.382308 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526758a7-3ae9-4942-bd20-165dcf9794ef None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:34.382592 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526758a7-3ae9-4942-bd20-165dcf9794ef None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:34.382866 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526758a7-3ae9-4942-bd20-165dcf9794ef None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:34.383494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526758a7-3ae9-4942-bd20-165dcf9794ef None admin] RBAC: Adding query filter params (type=compute) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:34.383798 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526758a7-3ae9-4942-bd20-165dcf9794ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:34.385197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526758a7-3ae9-4942-bd20-165dcf9794ef None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:34.386454 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:34.400122 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 394/795] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:34.802716 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7403b-9fb0-4462-87d0-4744795e7fbd None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:34.803245 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7403b-9fb0-4462-87d0-4744795e7fbd None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:34.803245 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7403b-9fb0-4462-87d0-4744795e7fbd None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:34.804674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 402/796] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:34.810049 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f1e5c-cb2a-4a65-9086-b62f40f37484 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:34.810452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f1e5c-cb2a-4a65-9086-b62f40f37484 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:34.810596 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f1e5c-cb2a-4a65-9086-b62f40f37484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:34.829100 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-091f1e5c-cb2a-4a65-9086-b62f40f37484 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:34.830301 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-091f1e5c-cb2a-4a65-9086-b62f40f37484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:34.898944 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 395/797] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:34 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:35.225201 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7403b-9fb0-4462-87d0-4744795e7fbd None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:35.327427 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7403b-9fb0-4462-87d0-4744795e7fbd None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:35.361394 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c024b-75f0-4cc3-87e2-5263c9ec74f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:35.361991 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c024b-75f0-4cc3-87e2-5263c9ec74f1 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:35.362265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c024b-75f0-4cc3-87e2-5263c9ec74f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:35.362532 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c024b-75f0-4cc3-87e2-5263c9ec74f1 None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:35.363167 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c024b-75f0-4cc3-87e2-5263c9ec74f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:35.365103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c024b-75f0-4cc3-87e2-5263c9ec74f1 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:35.367681 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: WARNING keystone.server.flask.common [None req-f43c024b-75f0-4cc3-87e2-5263c9ec74f1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 22:08:35.376115 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:35.385241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.sql.core [None req-f43c024b-75f0-4cc3-87e2-5263c9ec74f1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 22:08:35.385241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 22:08:35.385241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [parameters: {'id': '158faa214cfc4c5eaa8fd88cfed3831b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 22:08:35.385241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88404) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-f43c024b-75f0-4cc3-87e2-5263c9ec74f1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 158faa214cfc4c5eaa8fd88cfed3831b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 158faa214cfc4c5eaa8fd88cfed3831b. Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:08:35.405089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application result.read() Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 22:08:35.406114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application yield resource Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise self.value Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application session.commit() Aug 23 22:08:35.407102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self.session.flush() Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application compat.raise_( Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 22:08:35.408059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 22:08:35.409007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application result.read() Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:08:35.409830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [parameters: {'id': '158faa214cfc4c5eaa8fd88cfed3831b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:35.410704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:35.411549 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:35.415007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:35.415007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 22:08:35.415007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 22:08:35.415007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:35.415007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:35.415007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 22:08:35.415007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 22:08:35.415007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 158faa214cfc4c5eaa8fd88cfed3831b. Aug 23 22:08:35.415007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:35.415007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 403/798] 10.222.0.58 () {60 vars in 1140 bytes} [Tue Aug 23 22:08:35 2022] POST /identity/v3/projects => generated 262 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:08:35.415764 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f1e5c-cb2a-4a65-9086-b62f40f37484 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:35.531389 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f1e5c-cb2a-4a65-9086-b62f40f37484 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:35.558410 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:35.566209 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea72ce-59b4-4fc8-aa7a-d73deee329ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:35.566830 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea72ce-59b4-4fc8-aa7a-d73deee329ed None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:35.567159 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea72ce-59b4-4fc8-aa7a-d73deee329ed None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:35.567664 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea72ce-59b4-4fc8-aa7a-d73deee329ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:35.574177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea72ce-59b4-4fc8-aa7a-d73deee329ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:35.575617 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea72ce-59b4-4fc8-aa7a-d73deee329ed None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-ddea72ce-59b4-4fc8-aa7a-d73deee329ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:08:35.587143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:35.588096 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:35.589002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:08:35.589002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:08:35.589002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:08:35.589002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:08:35.589002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:08:35.589002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:08:35.589002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:08:35.589002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:35.589002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 396/799] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:35.594415 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c024b-75f0-4cc3-87e2-5263c9ec74f1 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:35.694176 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c024b-75f0-4cc3-87e2-5263c9ec74f1 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:35.727270 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2603a57-a56c-4c95-8999-307a785d7abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:35.727888 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2603a57-a56c-4c95-8999-307a785d7abd None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:35.728172 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2603a57-a56c-4c95-8999-307a785d7abd None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:35.728442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2603a57-a56c-4c95-8999-307a785d7abd None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:35.729089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2603a57-a56c-4c95-8999-307a785d7abd None admin] RBAC: Adding query filter params (name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:35.729389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2603a57-a56c-4c95-8999-307a785d7abd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:35.731012 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2603a57-a56c-4c95-8999-307a785d7abd None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:35.750791 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 404/800] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:36.598143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef76ce-b1c4-4948-af76-c20937c01774 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:36.599311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef76ce-b1c4-4948-af76-c20937c01774 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:36.599311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef76ce-b1c4-4948-af76-c20937c01774 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:36.601051 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 397/801] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:36.608269 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdba91-ee21-4f96-9e6c-debb1ba43ed6 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:36.608743 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdba91-ee21-4f96-9e6c-debb1ba43ed6 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:36.608823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdba91-ee21-4f96-9e6c-debb1ba43ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:36.633428 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-a1cdba91-ee21-4f96-9e6c-debb1ba43ed6 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:36.634960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-a1cdba91-ee21-4f96-9e6c-debb1ba43ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:36.690191 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:36.710602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 405/802] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:36 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:37.045438 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef76ce-b1c4-4948-af76-c20937c01774 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:37.146666 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef76ce-b1c4-4948-af76-c20937c01774 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:37.181254 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c763-539e-4b89-b95a-79f0f3f02fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:37.181857 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c763-539e-4b89-b95a-79f0f3f02fe4 None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:37.182192 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c763-539e-4b89-b95a-79f0f3f02fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:37.182465 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c763-539e-4b89-b95a-79f0f3f02fe4 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:37.183090 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1c763-539e-4b89-b95a-79f0f3f02fe4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:37.184489 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1c763-539e-4b89-b95a-79f0f3f02fe4 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:37.198561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 398/803] 10.222.0.58 () {60 vars in 1141 bytes} [Tue Aug 23 22:08:37 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:38.009344 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e7ecd-b711-49d2-8a64-28d42c94a7a5 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:38.009901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e7ecd-b711-49d2-8a64-28d42c94a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:38.009901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e7ecd-b711-49d2-8a64-28d42c94a7a5 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:38.011222 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 406/804] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:38.016685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cb8d4-3add-4875-b63a-86fd845b373f None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:38.017103 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cb8d4-3add-4875-b63a-86fd845b373f None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:38.017229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cb8d4-3add-4875-b63a-86fd845b373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:38.034736 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-3b0cb8d4-3add-4875-b63a-86fd845b373f None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:38.036536 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-3b0cb8d4-3add-4875-b63a-86fd845b373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:38.078578 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:38.108216 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 399/805] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:38 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:38.439863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e7ecd-b711-49d2-8a64-28d42c94a7a5 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:38.540672 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e7ecd-b711-49d2-8a64-28d42c94a7a5 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:38.573661 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c01c-b3c3-4ed1-974e-09e1e61eed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:38.574255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c01c-b3c3-4ed1-974e-09e1e61eed59 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:38.574534 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c01c-b3c3-4ed1-974e-09e1e61eed59 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:38.574805 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531c01c-b3c3-4ed1-974e-09e1e61eed59 None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:38.575435 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531c01c-b3c3-4ed1-974e-09e1e61eed59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:38.576898 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531c01c-b3c3-4ed1-974e-09e1e61eed59 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:38.592664 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.sql.core [None req-d531c01c-b3c3-4ed1-974e-09e1e61eed59 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 22:08:38.592664 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 22:08:38.592664 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [parameters: {'user_id': '5bbfaefeeb534159a6d247967f54e133', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 22:08:38.592664 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88404) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-d531c01c-b3c3-4ed1-974e-09e1e61eed59 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application result.read() Aug 23 22:08:38.599784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:08:38.600827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application yield resource Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application next(self.gen) Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise self.value Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application session.commit() Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 22:08:38.602340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self.session.flush() Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application compat.raise_( Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 22:08:38.603321 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 22:08:38.604279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application conn.query(q) Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application result.read() Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 22:08:38.605124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [parameters: {'user_id': '5bbfaefeeb534159a6d247967f54e133', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:38.607170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 22:08:38.608602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 22:08:38.609925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 22:08:38.609925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 22:08:38.609925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 22:08:38.609925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 22:08:38.609925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 22:08:38.609925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:38.609925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 407/806] 10.222.0.58 () {60 vars in 1131 bytes} [Tue Aug 23 22:08:38 2022] POST /identity/v3/users => generated 160 bytes in 162 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:38.610420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cb8d4-3add-4875-b63a-86fd845b373f None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:38.707074 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cb8d4-3add-4875-b63a-86fd845b373f None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:38.740856 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967b7d2-c18e-4c37-a59e-683321f22a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:38.741481 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b7d2-c18e-4c37-a59e-683321f22a2d None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:38.741759 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b7d2-c18e-4c37-a59e-683321f22a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:38.742030 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967b7d2-c18e-4c37-a59e-683321f22a2d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:38.748856 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967b7d2-c18e-4c37-a59e-683321f22a2d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:38.750299 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967b7d2-c18e-4c37-a59e-683321f22a2d None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-a967b7d2-c18e-4c37-a59e-683321f22a2d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:08:38.762163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:38.763268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:38.769210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:38.769210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:38.769210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:08:38.769210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:08:38.769210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:08:38.769210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:08:38.769210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:08:38.769210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:08:38.769210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 22:08:38.769210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:38.769210 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 400/807] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:08:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:38.770118 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c01c-b3c3-4ed1-974e-09e1e61eed59 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:38.818460 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:38.873581 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531c01c-b3c3-4ed1-974e-09e1e61eed59 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:38.907980 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bc1f3-2c2f-496e-adb3-a91b534374fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:38.908579 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bc1f3-2c2f-496e-adb3-a91b534374fe None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:38.908856 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bc1f3-2c2f-496e-adb3-a91b534374fe None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:38.909125 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bc1f3-2c2f-496e-adb3-a91b534374fe None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:38.909815 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bc1f3-2c2f-496e-adb3-a91b534374fe None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:38.910117 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bc1f3-2c2f-496e-adb3-a91b534374fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:38.911912 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1bc1f3-2c2f-496e-adb3-a91b534374fe None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:38.953679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 408/808] 10.222.0.58 () {56 vars in 1101 bytes} [Tue Aug 23 22:08:38 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:08:39.439075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e2546-5dfd-439d-953b-558572cd1e74 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:39.439626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e2546-5dfd-439d-953b-558572cd1e74 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:39.439626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e2546-5dfd-439d-953b-558572cd1e74 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:39.440974 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 401/809] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:39.447227 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdacddd-fda5-4fa9-91e8-695c8e378b51 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:39.447643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdacddd-fda5-4fa9-91e8-695c8e378b51 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:39.447797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdacddd-fda5-4fa9-91e8-695c8e378b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:39.465667 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-3cdacddd-fda5-4fa9-91e8-695c8e378b51 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:39.467192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-3cdacddd-fda5-4fa9-91e8-695c8e378b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:39.531624 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 409/810] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:39 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 22:08:39.857731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e2546-5dfd-439d-953b-558572cd1e74 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:39.894034 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:39.961285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e2546-5dfd-439d-953b-558572cd1e74 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:39.995882 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659dfd9-7657-409d-bbb5-b250cd3d8189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:39.996503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659dfd9-7657-409d-bbb5-b250cd3d8189 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:39.996788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659dfd9-7657-409d-bbb5-b250cd3d8189 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:39.997063 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659dfd9-7657-409d-bbb5-b250cd3d8189 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:39.997638 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659dfd9-7657-409d-bbb5-b250cd3d8189 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:39.999035 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659dfd9-7657-409d-bbb5-b250cd3d8189 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-8659dfd9-7657-409d-bbb5-b250cd3d8189 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:40.008161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:40.009296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:08:40.010269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 402/811] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:40.015398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdacddd-fda5-4fa9-91e8-695c8e378b51 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:40.055719 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:40.121957 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdacddd-fda5-4fa9-91e8-695c8e378b51 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:40.154618 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87a9a4-6040-447d-b237-d397221ba44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:40.155212 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87a9a4-6040-447d-b237-d397221ba44a None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.155490 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87a9a4-6040-447d-b237-d397221ba44a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.155758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87a9a4-6040-447d-b237-d397221ba44a None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.156407 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87a9a4-6040-447d-b237-d397221ba44a None admin] RBAC: Adding query filter params (name=compute) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:40.156707 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87a9a4-6040-447d-b237-d397221ba44a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:40.158066 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87a9a4-6040-447d-b237-d397221ba44a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:40.163408 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 410/812] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:40.169175 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659dfd9-7657-409d-bbb5-b250cd3d8189 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:40.262617 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:40.266538 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659dfd9-7657-409d-bbb5-b250cd3d8189 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:40.299176 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e743e6c-51be-4cc2-879f-5c2822fdac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:40.299765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e743e6c-51be-4cc2-879f-5c2822fdac99 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.300070 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e743e6c-51be-4cc2-879f-5c2822fdac99 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.300338 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e743e6c-51be-4cc2-879f-5c2822fdac99 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.300951 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e743e6c-51be-4cc2-879f-5c2822fdac99 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:40.301385 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e743e6c-51be-4cc2-879f-5c2822fdac99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:40.302828 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e743e6c-51be-4cc2-879f-5c2822fdac99 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:40.307416 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 403/813] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:40.313469 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87a9a4-6040-447d-b237-d397221ba44a None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:40.408510 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:40.412447 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87a9a4-6040-447d-b237-d397221ba44a None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:40.445607 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b84e1-0660-45fc-a3dc-862ff090fbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:40.446209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b84e1-0660-45fc-a3dc-862ff090fbd4 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.446482 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b84e1-0660-45fc-a3dc-862ff090fbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.446750 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b84e1-0660-45fc-a3dc-862ff090fbd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.447436 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b84e1-0660-45fc-a3dc-862ff090fbd4 None admin] RBAC: Adding query filter params (interface=public, service_id=07047837ba5c46b1b460398fc913e47c, region_id=RegionOne) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:40.448001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b84e1-0660-45fc-a3dc-862ff090fbd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:40.449123 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b84e1-0660-45fc-a3dc-862ff090fbd4 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:40.454013 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 411/814] 10.222.0.58 () {56 vars in 1251 bytes} [Tue Aug 23 22:08:40 2022] GET /identity/v3/endpoints?service_id=07047837ba5c46b1b460398fc913e47c&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:40.460258 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e743e6c-51be-4cc2-879f-5c2822fdac99 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:40.560130 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e743e6c-51be-4cc2-879f-5c2822fdac99 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:40.596917 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495b79b-8ee5-42af-8765-243127a3a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:40.597513 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495b79b-8ee5-42af-8765-243127a3a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:40.597795 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495b79b-8ee5-42af-8765-243127a3a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:40.598709 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495b79b-8ee5-42af-8765-243127a3a2a8 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:40.599360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495b79b-8ee5-42af-8765-243127a3a2a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:40.600867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495b79b-8ee5-42af-8765-243127a3a2a8 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:40.606987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 404/815] 10.222.0.58 () {56 vars in 1087 bytes} [Tue Aug 23 22:08:40 2022] GET /identity/v3/services => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:08:42.816036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63555e16-d67b-4f4e-989e-2e5a4f808c70 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:42.816565 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63555e16-d67b-4f4e-989e-2e5a4f808c70 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:42.816565 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63555e16-d67b-4f4e-989e-2e5a4f808c70 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:42.818533 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 412/816] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:08:42.823809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1276d3-6b7f-4048-b1bd-1bcf756b92e4 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:42.824251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1276d3-6b7f-4048-b1bd-1bcf756b92e4 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:42.824375 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1276d3-6b7f-4048-b1bd-1bcf756b92e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:42.841893 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-6c1276d3-6b7f-4048-b1bd-1bcf756b92e4 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:08:42.843058 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-6c1276d3-6b7f-4048-b1bd-1bcf756b92e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:08:42.863115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:42.909647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 405/817] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:08:42 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:08:43.241729 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63555e16-d67b-4f4e-989e-2e5a4f808c70 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:43.341946 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63555e16-d67b-4f4e-989e-2e5a4f808c70 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:43.374393 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890896-1e65-4d38-aa40-a40dc0519e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:43.375007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890896-1e65-4d38-aa40-a40dc0519e72 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.375289 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890896-1e65-4d38-aa40-a40dc0519e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.375563 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8890896-1e65-4d38-aa40-a40dc0519e72 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.376159 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8890896-1e65-4d38-aa40-a40dc0519e72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:43.377519 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8890896-1e65-4d38-aa40-a40dc0519e72 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-f8890896-1e65-4d38-aa40-a40dc0519e72 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:08:43.386660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:08:43.387849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:08:43.388715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 413/818] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:08:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:08:43.393673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1276d3-6b7f-4048-b1bd-1bcf756b92e4 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:43.490976 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1276d3-6b7f-4048-b1bd-1bcf756b92e4 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:43.524597 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb40141-9600-4137-9062-0f9d390bc454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:43.525183 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb40141-9600-4137-9062-0f9d390bc454 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.525461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb40141-9600-4137-9062-0f9d390bc454 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.525731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb40141-9600-4137-9062-0f9d390bc454 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.526347 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb40141-9600-4137-9062-0f9d390bc454 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:43.526645 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb40141-9600-4137-9062-0f9d390bc454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:43.528036 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb40141-9600-4137-9062-0f9d390bc454 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:43.532709 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 406/819] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:43.538979 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890896-1e65-4d38-aa40-a40dc0519e72 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:43.566386 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:43.637172 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8890896-1e65-4d38-aa40-a40dc0519e72 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:43.668861 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f890ca-0fad-4cda-baa8-39f9d2f48ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:43.669440 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f890ca-0fad-4cda-baa8-39f9d2f48ebc None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.669718 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f890ca-0fad-4cda-baa8-39f9d2f48ebc None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.669985 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f890ca-0fad-4cda-baa8-39f9d2f48ebc None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.670597 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f890ca-0fad-4cda-baa8-39f9d2f48ebc None admin] RBAC: Adding query filter params (type=compute) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:08:43.670892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f890ca-0fad-4cda-baa8-39f9d2f48ebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:43.672277 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f890ca-0fad-4cda-baa8-39f9d2f48ebc None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:43.677974 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 414/820] 10.222.0.58 () {56 vars in 1112 bytes} [Tue Aug 23 22:08:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:08:43.684685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb40141-9600-4137-9062-0f9d390bc454 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:08:43.710763 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:43.787552 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb40141-9600-4137-9062-0f9d390bc454 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:08:43.820743 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba46ebf-de95-4dde-9ed8-be9c591ca1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:08:43.821340 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46ebf-de95-4dde-9ed8-be9c591ca1d3 None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:08:43.821620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46ebf-de95-4dde-9ed8-be9c591ca1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:08:43.821892 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba46ebf-de95-4dde-9ed8-be9c591ca1d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:08:43.822565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba46ebf-de95-4dde-9ed8-be9c591ca1d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:08:43.823955 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba46ebf-de95-4dde-9ed8-be9c591ca1d3 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:08:43.842126 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 407/821] 10.222.0.58 () {60 vars in 1144 bytes} [Tue Aug 23 22:08:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:08:53.674569 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=55 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:08:53.838127 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=61,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:46.575607 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdd05b-a15a-4d0e-bcd7-31963bef9711 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:46.576251 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdd05b-a15a-4d0e-bcd7-31963bef9711 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:46.576251 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdd05b-a15a-4d0e-bcd7-31963bef9711 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:46.577425 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 415/822] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:46.584788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed074efa-d5e4-4134-9160-6f90baf420fb None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:46.585327 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed074efa-d5e4-4134-9160-6f90baf420fb None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:46.585600 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed074efa-d5e4-4134-9160-6f90baf420fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:46.611517 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-ed074efa-d5e4-4134-9160-6f90baf420fb None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:46.613471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-ed074efa-d5e4-4134-9160-6f90baf420fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:46.701444 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 408/823] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:46 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:47.079097 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdd05b-a15a-4d0e-bcd7-31963bef9711 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:47.209681 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdd05b-a15a-4d0e-bcd7-31963bef9711 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:47.252075 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed4701-15a9-4037-8756-fffb94aba2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:47.252826 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed4701-15a9-4037-8756-fffb94aba2a4 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:47.253043 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed4701-15a9-4037-8756-fffb94aba2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:47.253322 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ed4701-15a9-4037-8756-fffb94aba2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:47.264194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed4701-15a9-4037-8756-fffb94aba2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:47.265670 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ed4701-15a9-4037-8756-fffb94aba2a4 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-b2ed4701-15a9-4037-8756-fffb94aba2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:47.282096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:47.283182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:47.285199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:47.285199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:47.285199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:09:47.289199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 416/824] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:47.290242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed074efa-d5e4-4134-9160-6f90baf420fb None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:47.421525 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed074efa-d5e4-4134-9160-6f90baf420fb None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:47.451162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:47.465022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b8fdd-2df7-4094-8ee5-1bec2694400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:47.465022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8fdd-2df7-4094-8ee5-1bec2694400f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:47.465022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8fdd-2df7-4094-8ee5-1bec2694400f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:47.465022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8fdd-2df7-4094-8ee5-1bec2694400f None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:47.465466 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b8fdd-2df7-4094-8ee5-1bec2694400f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:47.465466 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b8fdd-2df7-4094-8ee5-1bec2694400f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:47.465797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b8fdd-2df7-4094-8ee5-1bec2694400f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:47.478538 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 409/825] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:47.484923 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed4701-15a9-4037-8756-fffb94aba2a4 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:47.558118 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:47.626074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ed4701-15a9-4037-8756-fffb94aba2a4 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:47.666877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44590093-e9e3-4d5d-b441-aad5a4cb906c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:47.667632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590093-e9e3-4d5d-b441-aad5a4cb906c None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:47.667987 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590093-e9e3-4d5d-b441-aad5a4cb906c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:47.668329 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590093-e9e3-4d5d-b441-aad5a4cb906c None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:47.669058 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44590093-e9e3-4d5d-b441-aad5a4cb906c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:47.670934 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44590093-e9e3-4d5d-b441-aad5a4cb906c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:47.698209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 417/826] 10.222.0.58 () {60 vars in 1132 bytes} [Tue Aug 23 22:09:47 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:09:50.083140 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83287b-14cb-457d-b2a4-a57e32abf947 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:50.083868 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83287b-14cb-457d-b2a4-a57e32abf947 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:50.083868 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83287b-14cb-457d-b2a4-a57e32abf947 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:50.085277 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 410/827] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:50.091153 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528039b-70c1-45a3-aec5-0e231f8b128f None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:50.091593 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528039b-70c1-45a3-aec5-0e231f8b128f None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:50.093540 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528039b-70c1-45a3-aec5-0e231f8b128f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:50.117450 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-3528039b-70c1-45a3-aec5-0e231f8b128f None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:50.118638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-3528039b-70c1-45a3-aec5-0e231f8b128f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:50.192142 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 418/828] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:50 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:50.538228 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83287b-14cb-457d-b2a4-a57e32abf947 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:50.657665 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83287b-14cb-457d-b2a4-a57e32abf947 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:50.698066 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beae70-3838-40e5-bd4d-d3d009f3720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:50.698605 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beae70-3838-40e5-bd4d-d3d009f3720c None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:50.698895 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beae70-3838-40e5-bd4d-d3d009f3720c None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:50.699159 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21beae70-3838-40e5-bd4d-d3d009f3720c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:50.710331 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21beae70-3838-40e5-bd4d-d3d009f3720c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-21beae70-3838-40e5-bd4d-d3d009f3720c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:50.715003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:50.716038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:09:50.716883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 411/829] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:09:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:50.723392 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528039b-70c1-45a3-aec5-0e231f8b128f None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:50.769525 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:50.841531 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528039b-70c1-45a3-aec5-0e231f8b128f None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:50.881482 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17d923-dd78-4596-97e1-231150861058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:50.882275 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17d923-dd78-4596-97e1-231150861058 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:50.882645 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17d923-dd78-4596-97e1-231150861058 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:50.883011 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17d923-dd78-4596-97e1-231150861058 None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:50.883797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17d923-dd78-4596-97e1-231150861058 None admin] RBAC: Adding query filter params (name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:50.884166 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17d923-dd78-4596-97e1-231150861058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:50.885708 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17d923-dd78-4596-97e1-231150861058 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:50.895741 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 419/830] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:09:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:50.901677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beae70-3838-40e5-bd4d-d3d009f3720c None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:50.957040 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:51.021860 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21beae70-3838-40e5-bd4d-d3d009f3720c None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:51.060735 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec40b0-d823-462c-b3c0-e005193f9f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:51.061359 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec40b0-d823-462c-b3c0-e005193f9f05 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:51.061637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec40b0-d823-462c-b3c0-e005193f9f05 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:51.061906 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec40b0-d823-462c-b3c0-e005193f9f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:51.072658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec40b0-d823-462c-b3c0-e005193f9f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:51.074315 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec40b0-d823-462c-b3c0-e005193f9f05 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-d6ec40b0-d823-462c-b3c0-e005193f9f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:51.090237 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:51.097461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:51.098366 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:51.098366 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:51.098366 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:09:51.098366 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 412/831] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:51.098589 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17d923-dd78-4596-97e1-231150861058 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.202900 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:51.206937 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17d923-dd78-4596-97e1-231150861058 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:51.245994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff42dd-cfa1-42cc-87db-630cc6d9f9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:51.246604 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff42dd-cfa1-42cc-87db-630cc6d9f9c3 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:51.246893 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff42dd-cfa1-42cc-87db-630cc6d9f9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:51.247178 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff42dd-cfa1-42cc-87db-630cc6d9f9c3 None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:51.247959 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff42dd-cfa1-42cc-87db-630cc6d9f9c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:51.248302 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff42dd-cfa1-42cc-87db-630cc6d9f9c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:51.250167 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff42dd-cfa1-42cc-87db-630cc6d9f9c3 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:51.267297 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 420/832] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:51.274065 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec40b0-d823-462c-b3c0-e005193f9f05 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.381344 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:51.384878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec40b0-d823-462c-b3c0-e005193f9f05 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:51.419659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e58060-014f-4a11-9b40-9d43b9509653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:51.420308 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e58060-014f-4a11-9b40-9d43b9509653 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:51.420585 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e58060-014f-4a11-9b40-9d43b9509653 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:51.420849 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e58060-014f-4a11-9b40-9d43b9509653 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:51.429145 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e58060-014f-4a11-9b40-9d43b9509653 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:51.430585 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e58060-014f-4a11-9b40-9d43b9509653 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-11e58060-014f-4a11-9b40-9d43b9509653 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:51.442075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:51.443186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:51.444205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:51.444205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:51.444205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:51.444205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:51.444205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:51.444205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:51.444205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:51.444205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:51.444205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:09:51.444205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:09:51.444205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 413/833] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:51.449008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff42dd-cfa1-42cc-87db-630cc6d9f9c3 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.553508 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff42dd-cfa1-42cc-87db-630cc6d9f9c3 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:51.588080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb08ae-232b-4102-9a4c-9f062f520d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:51.588683 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb08ae-232b-4102-9a4c-9f062f520d34 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:51.588963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb08ae-232b-4102-9a4c-9f062f520d34 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:51.589237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb08ae-232b-4102-9a4c-9f062f520d34 None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:51.589957 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb08ae-232b-4102-9a4c-9f062f520d34 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:51.590260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb08ae-232b-4102-9a4c-9f062f520d34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:51.591699 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb08ae-232b-4102-9a4c-9f062f520d34 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:51.611088 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 421/834] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Aug 23 22:09:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:51.617365 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e58060-014f-4a11-9b40-9d43b9509653 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.728575 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e58060-014f-4a11-9b40-9d43b9509653 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:51.765523 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf8c39-e161-4ade-b85e-7f414eb744e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:51.766134 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf8c39-e161-4ade-b85e-7f414eb744e0 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:51.766430 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf8c39-e161-4ade-b85e-7f414eb744e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:51.766688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf8c39-e161-4ade-b85e-7f414eb744e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:51.796565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:51.845582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf8c39-e161-4ade-b85e-7f414eb744e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:51.847338 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf8c39-e161-4ade-b85e-7f414eb744e0 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:51.949738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 414/835] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:09:51 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 22:09:51.956215 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb08ae-232b-4102-9a4c-9f062f520d34 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:51.976180 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:52.066173 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb08ae-232b-4102-9a4c-9f062f520d34 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:52.105823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a60489-b10e-49ff-880c-e9d20c666285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:52.106502 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a60489-b10e-49ff-880c-e9d20c666285 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:52.106717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a60489-b10e-49ff-880c-e9d20c666285 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:52.106992 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a60489-b10e-49ff-880c-e9d20c666285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:52.120894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a60489-b10e-49ff-880c-e9d20c666285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:52.122776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a60489-b10e-49ff-880c-e9d20c666285 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-b1a60489-b10e-49ff-880c-e9d20c666285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:52.139194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:52.140572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:52.141827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:52.141827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:52.141827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:09:52.141827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 422/836] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:52.147306 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf8c39-e161-4ade-b85e-7f414eb744e0 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:52.209389 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:52.256386 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf8c39-e161-4ade-b85e-7f414eb744e0 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:52.292803 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d774ed9-7f3c-4c91-845c-dadfdad94efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:52.293417 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d774ed9-7f3c-4c91-845c-dadfdad94efb None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:52.293677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d774ed9-7f3c-4c91-845c-dadfdad94efb None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:52.293945 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d774ed9-7f3c-4c91-845c-dadfdad94efb None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:52.294572 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d774ed9-7f3c-4c91-845c-dadfdad94efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:52.294866 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d774ed9-7f3c-4c91-845c-dadfdad94efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:52.296270 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d774ed9-7f3c-4c91-845c-dadfdad94efb None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:52.308722 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 415/837] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:52.314210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a60489-b10e-49ff-880c-e9d20c666285 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:52.392313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:52.425722 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a60489-b10e-49ff-880c-e9d20c666285 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:52.466029 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1e991-a29d-4e14-b0d6-66e9a8915976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:52.466697 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1e991-a29d-4e14-b0d6-66e9a8915976 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:52.466985 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1e991-a29d-4e14-b0d6-66e9a8915976 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:52.467271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1e991-a29d-4e14-b0d6-66e9a8915976 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:52.475152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1e991-a29d-4e14-b0d6-66e9a8915976 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:52.476713 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1e991-a29d-4e14-b0d6-66e9a8915976 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-33b1e991-a29d-4e14-b0d6-66e9a8915976 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:52.489481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:52.491030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:52.492152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:52.492152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:52.492152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:52.492152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:52.492152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:52.492152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:52.492152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:52.492152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:09:52.492152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 423/838] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:52.496899 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d774ed9-7f3c-4c91-845c-dadfdad94efb None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:52.613742 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d774ed9-7f3c-4c91-845c-dadfdad94efb None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:52.632753 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:52.654100 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45d4d4-e5e2-4896-9479-68c38894f3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:52.654697 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45d4d4-e5e2-4896-9479-68c38894f3ef None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:52.654990 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45d4d4-e5e2-4896-9479-68c38894f3ef None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:52.655262 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45d4d4-e5e2-4896-9479-68c38894f3ef None admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:52.656158 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45d4d4-e5e2-4896-9479-68c38894f3ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:52.656472 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45d4d4-e5e2-4896-9479-68c38894f3ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:52.657923 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45d4d4-e5e2-4896-9479-68c38894f3ef None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:52.671793 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 416/839] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:52.678854 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1e991-a29d-4e14-b0d6-66e9a8915976 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:52.819436 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1e991-a29d-4e14-b0d6-66e9a8915976 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:52.851899 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:52.857860 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff75299-9f43-4b49-b602-a0dbb7529787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:52.858459 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff75299-9f43-4b49-b602-a0dbb7529787 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:52.858741 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff75299-9f43-4b49-b602-a0dbb7529787 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:52.859013 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff75299-9f43-4b49-b602-a0dbb7529787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:52.859728 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff75299-9f43-4b49-b602-a0dbb7529787 None admin] RBAC: Adding query filter params (role.id=3db17b52a09844b88bc370419f6c6265, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=7a55d53b8c1a4dffa00b9114d1df498a) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:52.860072 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff75299-9f43-4b49-b602-a0dbb7529787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:52.861538 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff75299-9f43-4b49-b602-a0dbb7529787 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:52.866876 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 424/840] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:09:52 2022] GET /identity/v3/role_assignments?user.id=7a55d53b8c1a4dffa00b9114d1df498a&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=3db17b52a09844b88bc370419f6c6265 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:55.122733 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc97b41-6cf4-4e92-a1c8-5c308002fd7f None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:55.123289 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc97b41-6cf4-4e92-a1c8-5c308002fd7f None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:55.123433 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc97b41-6cf4-4e92-a1c8-5c308002fd7f None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:55.124785 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 417/841] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:09:55.131856 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a00d5-c04f-4c74-8969-1a0f348a9561 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:55.132587 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a00d5-c04f-4c74-8969-1a0f348a9561 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:55.132862 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a00d5-c04f-4c74-8969-1a0f348a9561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:55.152423 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-f82a00d5-c04f-4c74-8969-1a0f348a9561 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:55.153762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-f82a00d5-c04f-4c74-8969-1a0f348a9561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:55.226475 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 425/842] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:55 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:09:55.571192 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc97b41-6cf4-4e92-a1c8-5c308002fd7f None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:55.684381 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc97b41-6cf4-4e92-a1c8-5c308002fd7f None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:55.718755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5568b-1ab5-4c0f-b587-c29dba0e9d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:55.719656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5568b-1ab5-4c0f-b587-c29dba0e9d98 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:55.719949 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5568b-1ab5-4c0f-b587-c29dba0e9d98 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:55.720229 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5568b-1ab5-4c0f-b587-c29dba0e9d98 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:55.731397 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5568b-1ab5-4c0f-b587-c29dba0e9d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-e3e5568b-1ab5-4c0f-b587-c29dba0e9d98 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:09:55.737531 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:55.738788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:09:55.739765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 418/843] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:09:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:55.745063 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a00d5-c04f-4c74-8969-1a0f348a9561 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:55.863343 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a00d5-c04f-4c74-8969-1a0f348a9561 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:55.889511 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:55.903754 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88962a-c655-4adb-a21a-a1101725bc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:55.904417 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88962a-c655-4adb-a21a-a1101725bc3c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:55.904726 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88962a-c655-4adb-a21a-a1101725bc3c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:55.904969 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88962a-c655-4adb-a21a-a1101725bc3c None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:55.905741 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88962a-c655-4adb-a21a-a1101725bc3c None admin] RBAC: Adding query filter params (name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:55.906051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88962a-c655-4adb-a21a-a1101725bc3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:55.907524 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88962a-c655-4adb-a21a-a1101725bc3c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:55.916095 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 426/844] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:09:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:55.921835 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5568b-1ab5-4c0f-b587-c29dba0e9d98 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:55.970350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:56.038433 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5568b-1ab5-4c0f-b587-c29dba0e9d98 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:56.078871 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88eabf-bb11-40af-8412-b88ca2bfcd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:56.079527 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88eabf-bb11-40af-8412-b88ca2bfcd7d None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:56.079993 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88eabf-bb11-40af-8412-b88ca2bfcd7d None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:56.080278 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88eabf-bb11-40af-8412-b88ca2bfcd7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:56.092278 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88eabf-bb11-40af-8412-b88ca2bfcd7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:56.093789 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88eabf-bb11-40af-8412-b88ca2bfcd7d None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-3f88eabf-bb11-40af-8412-b88ca2bfcd7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:56.110755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:56.112162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:56.113286 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:56.113286 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:56.113286 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:09:56.113286 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 419/845] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:56.117951 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88962a-c655-4adb-a21a-a1101725bc3c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:56.232127 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88962a-c655-4adb-a21a-a1101725bc3c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:56.275919 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb6464-62d7-4a20-879f-09cf752e11d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:56.276532 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb6464-62d7-4a20-879f-09cf752e11d1 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:56.276812 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb6464-62d7-4a20-879f-09cf752e11d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:56.277085 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb6464-62d7-4a20-879f-09cf752e11d1 None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:56.277726 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb6464-62d7-4a20-879f-09cf752e11d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:56.278032 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb6464-62d7-4a20-879f-09cf752e11d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:56.279410 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb6464-62d7-4a20-879f-09cf752e11d1 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:56.293101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 427/846] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:56.300495 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88eabf-bb11-40af-8412-b88ca2bfcd7d None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:56.404359 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:56.415215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88eabf-bb11-40af-8412-b88ca2bfcd7d None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:56.449596 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9fcae-3ce6-4d07-bad7-118f70b1f6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:56.450169 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9fcae-3ce6-4d07-bad7-118f70b1f6e3 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:56.450449 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9fcae-3ce6-4d07-bad7-118f70b1f6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:56.450717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9fcae-3ce6-4d07-bad7-118f70b1f6e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:56.459175 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9fcae-3ce6-4d07-bad7-118f70b1f6e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:56.460746 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9fcae-3ce6-4d07-bad7-118f70b1f6e3 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-0ea9fcae-3ce6-4d07-bad7-118f70b1f6e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:09:56.473341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:56.474658 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:56.475726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:56.475726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:56.475726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:09:56.475726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:09:56.475726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:09:56.475726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:09:56.475726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:09:56.475726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:09:56.475726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:09:56.475726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:09:56.475726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 420/847] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:56.480863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb6464-62d7-4a20-879f-09cf752e11d1 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:56.530959 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:56.589932 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb6464-62d7-4a20-879f-09cf752e11d1 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:56.629687 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94475bf1-0a31-4746-a1ac-8d2f840d6746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:56.630481 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94475bf1-0a31-4746-a1ac-8d2f840d6746 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:56.630829 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94475bf1-0a31-4746-a1ac-8d2f840d6746 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:56.631212 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94475bf1-0a31-4746-a1ac-8d2f840d6746 None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:56.632080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94475bf1-0a31-4746-a1ac-8d2f840d6746 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:56.632412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94475bf1-0a31-4746-a1ac-8d2f840d6746 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:56.634013 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94475bf1-0a31-4746-a1ac-8d2f840d6746 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:56.654583 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 428/848] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Aug 23 22:09:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:56.661873 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9fcae-3ce6-4d07-bad7-118f70b1f6e3 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:56.775518 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9fcae-3ce6-4d07-bad7-118f70b1f6e3 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:56.814034 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81c87d-76cc-49ef-91d6-f834296d55a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:56.815197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c87d-76cc-49ef-91d6-f834296d55a2 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:56.815473 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c87d-76cc-49ef-91d6-f834296d55a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:56.815739 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81c87d-76cc-49ef-91d6-f834296d55a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:56.827341 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81c87d-76cc-49ef-91d6-f834296d55a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:56.829151 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81c87d-76cc-49ef-91d6-f834296d55a2 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-fe81c87d-76cc-49ef-91d6-f834296d55a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:09:56.848215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:56.849281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:09:56.850236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:09:56.850236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:09:56.850236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:09:56.850236 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 421/849] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:09:56.856397 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94475bf1-0a31-4746-a1ac-8d2f840d6746 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:56.962102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94475bf1-0a31-4746-a1ac-8d2f840d6746 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:56.964711 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:56.999961 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fea45-db0f-46f0-aac2-5b43e128a833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:57.000594 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fea45-db0f-46f0-aac2-5b43e128a833 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:57.000926 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fea45-db0f-46f0-aac2-5b43e128a833 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:57.001167 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fea45-db0f-46f0-aac2-5b43e128a833 None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:57.001862 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fea45-db0f-46f0-aac2-5b43e128a833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:57.002253 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fea45-db0f-46f0-aac2-5b43e128a833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:57.003727 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fea45-db0f-46f0-aac2-5b43e128a833 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:57.016410 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 429/850] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:09:57.022544 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81c87d-76cc-49ef-91d6-f834296d55a2 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:57.025665 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:57.137273 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81c87d-76cc-49ef-91d6-f834296d55a2 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:57.178137 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975017e3-f7b3-4079-9104-213080e099e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:57.178941 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975017e3-f7b3-4079-9104-213080e099e8 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:57.179370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975017e3-f7b3-4079-9104-213080e099e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:57.179620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975017e3-f7b3-4079-9104-213080e099e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:57.187424 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975017e3-f7b3-4079-9104-213080e099e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:57.188946 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975017e3-f7b3-4079-9104-213080e099e8 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-975017e3-f7b3-4079-9104-213080e099e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:09:57.204177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:09:57.205281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:09:57.206452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:09:57.206452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:09:57.206452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:09:57.206452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:09:57.206452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:09:57.206452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:09:57.206452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:09:57.206452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:09:57.206452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 422/851] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:09:57.212034 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fea45-db0f-46f0-aac2-5b43e128a833 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:57.324573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fea45-db0f-46f0-aac2-5b43e128a833 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:57.362373 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ba73e-6b1f-4f70-8047-f23b4ac9d256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:57.363014 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ba73e-6b1f-4f70-8047-f23b4ac9d256 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:57.363297 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ba73e-6b1f-4f70-8047-f23b4ac9d256 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:57.363571 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ba73e-6b1f-4f70-8047-f23b4ac9d256 None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:57.364296 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ba73e-6b1f-4f70-8047-f23b4ac9d256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:09:57.364602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ba73e-6b1f-4f70-8047-f23b4ac9d256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:57.366131 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ba73e-6b1f-4f70-8047-f23b4ac9d256 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:57.378812 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 430/852] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:09:57.385052 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975017e3-f7b3-4079-9104-213080e099e8 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:09:57.454697 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:09:57.498932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975017e3-f7b3-4079-9104-213080e099e8 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:09:57.536631 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6088f31-80db-4374-a189-b11989f0ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:09:57.537364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6088f31-80db-4374-a189-b11989f0ef5f None admin] REQUEST_METHOD: `PUT` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:57.537684 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6088f31-80db-4374-a189-b11989f0ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:57.538012 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6088f31-80db-4374-a189-b11989f0ef5f None admin] PATH_INFO: `/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/7a55d53b8c1a4dffa00b9114d1df498a/roles/3db17b52a09844b88bc370419f6c6265` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:57.554798 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6088f31-80db-4374-a189-b11989f0ef5f None admin] RBAC: Authorizing `identity:create_grant(project_id=0d86eb186aa94e1bb4a358cfc19447b1, user_id=7a55d53b8c1a4dffa00b9114d1df498a, role_id=3db17b52a09844b88bc370419f6c6265)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:09:57.556281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6088f31-80db-4374-a189-b11989f0ef5f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:09:57.570076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 423/853] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:09:57 2022] PUT /identity/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/7a55d53b8c1a4dffa00b9114d1df498a/roles/3db17b52a09844b88bc370419f6c6265 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:09:59.785954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13508c1-0a0f-412e-bfc3-e50b2ef85599 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:59.786640 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13508c1-0a0f-412e-bfc3-e50b2ef85599 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:59.786640 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13508c1-0a0f-412e-bfc3-e50b2ef85599 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:59.791425 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 431/854] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:09:59.793248 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23c7e-4db0-49e5-8272-c7a1abbf19b4 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:09:59.793763 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23c7e-4db0-49e5-8272-c7a1abbf19b4 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:09:59.793763 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23c7e-4db0-49e5-8272-c7a1abbf19b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:09:59.812883 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-30c23c7e-4db0-49e5-8272-c7a1abbf19b4 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:09:59.814046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-30c23c7e-4db0-49e5-8272-c7a1abbf19b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:09:59.905323 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 424/855] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:09:59 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:00.249237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13508c1-0a0f-412e-bfc3-e50b2ef85599 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.277103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:00.359743 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13508c1-0a0f-412e-bfc3-e50b2ef85599 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.396897 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c11627-8abf-433a-a43f-9012163839d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.397511 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c11627-8abf-433a-a43f-9012163839d6 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.397791 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c11627-8abf-433a-a43f-9012163839d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.398065 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c11627-8abf-433a-a43f-9012163839d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:00.408848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c11627-8abf-433a-a43f-9012163839d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-59c11627-8abf-433a-a43f-9012163839d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:10:00.413970 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:00.415209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:00.416210 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 432/856] 10.222.0.58 () {56 vars in 1102 bytes} [Tue Aug 23 22:10:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:10:00.421564 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c23c7e-4db0-49e5-8272-c7a1abbf19b4 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.467606 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:00.527736 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c23c7e-4db0-49e5-8272-c7a1abbf19b4 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.568654 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dce60-8d4a-41db-9bfe-d02746b50186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.569263 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dce60-8d4a-41db-9bfe-d02746b50186 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.569543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dce60-8d4a-41db-9bfe-d02746b50186 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.569816 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dce60-8d4a-41db-9bfe-d02746b50186 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:00.570475 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dce60-8d4a-41db-9bfe-d02746b50186 None admin] RBAC: Adding query filter params (name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:00.570814 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dce60-8d4a-41db-9bfe-d02746b50186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:00.572204 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dce60-8d4a-41db-9bfe-d02746b50186 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:00.580909 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 425/857] 10.222.0.58 () {56 vars in 1103 bytes} [Tue Aug 23 22:10:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:00.586976 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c11627-8abf-433a-a43f-9012163839d6 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.681098 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:00.698934 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c11627-8abf-433a-a43f-9012163839d6 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.734324 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309446a-cf7f-426e-a11c-faf19dd1afc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.735013 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309446a-cf7f-426e-a11c-faf19dd1afc9 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.735305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309446a-cf7f-426e-a11c-faf19dd1afc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.735582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309446a-cf7f-426e-a11c-faf19dd1afc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:00.746992 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309446a-cf7f-426e-a11c-faf19dd1afc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:00.748716 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309446a-cf7f-426e-a11c-faf19dd1afc9 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-8309446a-cf7f-426e-a11c-faf19dd1afc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:00.764389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:00.765463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:00.766774 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:00.766774 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:00.766774 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:00.766774 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 433/858] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:00.771897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dce60-8d4a-41db-9bfe-d02746b50186 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:00.894615 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dce60-8d4a-41db-9bfe-d02746b50186 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:00.897459 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:00.934215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e4673-a745-404a-8aae-66885f452873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:00.934827 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4673-a745-404a-8aae-66885f452873 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:00.935110 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4673-a745-404a-8aae-66885f452873 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:00.935384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4673-a745-404a-8aae-66885f452873 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:00.936057 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e4673-a745-404a-8aae-66885f452873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:00.936364 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e4673-a745-404a-8aae-66885f452873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:00.937950 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e4673-a745-404a-8aae-66885f452873 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:00.951454 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 426/859] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:00.958714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309446a-cf7f-426e-a11c-faf19dd1afc9 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:01.070145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309446a-cf7f-426e-a11c-faf19dd1afc9 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:01.107695 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0cc24-6bb0-43b1-b59d-1afa91f5a7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:01.108368 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0cc24-6bb0-43b1-b59d-1afa91f5a7e2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:01.108649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0cc24-6bb0-43b1-b59d-1afa91f5a7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:01.108920 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0cc24-6bb0-43b1-b59d-1afa91f5a7e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:01.112153 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:01.117761 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0cc24-6bb0-43b1-b59d-1afa91f5a7e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:01.119961 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0cc24-6bb0-43b1-b59d-1afa91f5a7e2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-d8b0cc24-6bb0-43b1-b59d-1afa91f5a7e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:10:01.131918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:01.133468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:01.134749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:01.134749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:01.134749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:10:01.134749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:10:01.134749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:10:01.134749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:10:01.134749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:10:01.134749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:10:01.134749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:10:01.134749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:01.134749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 434/860] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:01.139586 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e4673-a745-404a-8aae-66885f452873 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:01.248903 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e4673-a745-404a-8aae-66885f452873 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:01.285852 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5f2b5-f68b-4108-ae9b-0776c6b83c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:01.286465 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5f2b5-f68b-4108-ae9b-0776c6b83c48 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:01.286739 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5f2b5-f68b-4108-ae9b-0776c6b83c48 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:01.287037 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5f2b5-f68b-4108-ae9b-0776c6b83c48 None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:01.287756 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5f2b5-f68b-4108-ae9b-0776c6b83c48 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:01.291466 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5f2b5-f68b-4108-ae9b-0776c6b83c48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:01.293649 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5f2b5-f68b-4108-ae9b-0776c6b83c48 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:01.315213 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 427/861] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Aug 23 22:10:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:01.321412 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0cc24-6bb0-43b1-b59d-1afa91f5a7e2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:01.439928 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0cc24-6bb0-43b1-b59d-1afa91f5a7e2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:01.483101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4f604-4859-4c5f-9d7b-2b356f5d315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:01.483713 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4f604-4859-4c5f-9d7b-2b356f5d315c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:01.484072 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4f604-4859-4c5f-9d7b-2b356f5d315c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:01.484316 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4f604-4859-4c5f-9d7b-2b356f5d315c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:01.554357 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:01.562250 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4f604-4859-4c5f-9d7b-2b356f5d315c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:01.563792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4f604-4859-4c5f-9d7b-2b356f5d315c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:01.672682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 435/862] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:01 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:10:01.678911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5f2b5-f68b-4108-ae9b-0776c6b83c48 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:01.705828 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:01.788616 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5f2b5-f68b-4108-ae9b-0776c6b83c48 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:01.834406 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b1255-2191-4bc8-a038-3134d1f82d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:01.834961 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b1255-2191-4bc8-a038-3134d1f82d30 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:01.835269 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b1255-2191-4bc8-a038-3134d1f82d30 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:01.835617 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b1255-2191-4bc8-a038-3134d1f82d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:01.848719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b1255-2191-4bc8-a038-3134d1f82d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:01.850474 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846b1255-2191-4bc8-a038-3134d1f82d30 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-846b1255-2191-4bc8-a038-3134d1f82d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:01.867804 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:01.869356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:01.871393 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:01.871393 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:01.871393 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:01.871393 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 428/863] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:01.875755 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4f604-4859-4c5f-9d7b-2b356f5d315c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:01.991649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:01.999359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4f604-4859-4c5f-9d7b-2b356f5d315c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:02.042758 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7d6ca-b9ce-4057-aa5e-88704dfe1a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:02.043533 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7d6ca-b9ce-4057-aa5e-88704dfe1a32 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:02.043822 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7d6ca-b9ce-4057-aa5e-88704dfe1a32 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:02.044134 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7d6ca-b9ce-4057-aa5e-88704dfe1a32 None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:02.045007 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7d6ca-b9ce-4057-aa5e-88704dfe1a32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:02.045416 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7d6ca-b9ce-4057-aa5e-88704dfe1a32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:02.047044 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7d6ca-b9ce-4057-aa5e-88704dfe1a32 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:02.060476 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 436/864] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:02.066709 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b1255-2191-4bc8-a038-3134d1f82d30 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:02.151029 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:02.180396 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b1255-2191-4bc8-a038-3134d1f82d30 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:02.220057 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f08db6-90fe-476c-9837-e4d1cb288bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:02.221282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f08db6-90fe-476c-9837-e4d1cb288bf0 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:02.221733 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f08db6-90fe-476c-9837-e4d1cb288bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:02.222175 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f08db6-90fe-476c-9837-e4d1cb288bf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:02.230291 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f08db6-90fe-476c-9837-e4d1cb288bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:02.231990 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f08db6-90fe-476c-9837-e4d1cb288bf0 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-75f08db6-90fe-476c-9837-e4d1cb288bf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:10:02.244559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:02.245659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:02.246910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:10:02.246910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:10:02.246910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:10:02.246910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:10:02.246910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:10:02.246910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:10:02.246910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:02.246910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:02.246910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 429/865] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:10:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:02.252772 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7d6ca-b9ce-4057-aa5e-88704dfe1a32 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:02.373006 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7d6ca-b9ce-4057-aa5e-88704dfe1a32 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:02.408082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e08c67-8bf0-40f4-9a4f-88dc8304298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:02.409218 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e08c67-8bf0-40f4-9a4f-88dc8304298e None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:02.409576 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e08c67-8bf0-40f4-9a4f-88dc8304298e None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:02.409749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e08c67-8bf0-40f4-9a4f-88dc8304298e None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:02.410426 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e08c67-8bf0-40f4-9a4f-88dc8304298e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:02.410732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e08c67-8bf0-40f4-9a4f-88dc8304298e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:02.412187 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e08c67-8bf0-40f4-9a4f-88dc8304298e None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:02.429877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 437/866] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:10:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:02.431249 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f08db6-90fe-476c-9837-e4d1cb288bf0 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:02.543657 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f08db6-90fe-476c-9837-e4d1cb288bf0 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:02.585792 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadb31b-11f1-44b5-b992-3daed63f62a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:02.586600 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadb31b-11f1-44b5-b992-3daed63f62a5 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:02.586980 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadb31b-11f1-44b5-b992-3daed63f62a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:02.587353 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadb31b-11f1-44b5-b992-3daed63f62a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:02.588288 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadb31b-11f1-44b5-b992-3daed63f62a5 None admin] RBAC: Adding query filter params (role.id=3db17b52a09844b88bc370419f6c6265, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=7a55d53b8c1a4dffa00b9114d1df498a) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:02.588636 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadb31b-11f1-44b5-b992-3daed63f62a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:02.590316 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadb31b-11f1-44b5-b992-3daed63f62a5 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:02.592529 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:02.599619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 430/867] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:10:02 2022] GET /identity/v3/role_assignments?user.id=7a55d53b8c1a4dffa00b9114d1df498a&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=3db17b52a09844b88bc370419f6c6265 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:04.951544 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ec725-5f93-4e3a-956d-4c2693d0f763 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:04.952131 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ec725-5f93-4e3a-956d-4c2693d0f763 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:04.952131 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ec725-5f93-4e3a-956d-4c2693d0f763 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:04.953554 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 438/868] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:04.959468 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fa31b-df8b-4005-8a24-4c2e4cbf5519 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:04.959932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fa31b-df8b-4005-8a24-4c2e4cbf5519 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:04.960042 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fa31b-df8b-4005-8a24-4c2e4cbf5519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:04.979135 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-a96fa31b-df8b-4005-8a24-4c2e4cbf5519 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:04.980332 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-a96fa31b-df8b-4005-8a24-4c2e4cbf5519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:05.057535 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 431/869] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:04 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:05.401591 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ec725-5f93-4e3a-956d-4c2693d0f763 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:05.421442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:05.514550 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ec725-5f93-4e3a-956d-4c2693d0f763 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:05.554624 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b09a8-3693-49b0-b4d6-5eeef4145a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:05.555328 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b09a8-3693-49b0-b4d6-5eeef4145a56 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:05.555610 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b09a8-3693-49b0-b4d6-5eeef4145a56 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:05.555943 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b09a8-3693-49b0-b4d6-5eeef4145a56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:05.567474 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b09a8-3693-49b0-b4d6-5eeef4145a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-583b09a8-3693-49b0-b4d6-5eeef4145a56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:10:05.572643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:05.573765 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:05.574674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 439/870] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:10:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 22:10:05.580965 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fa31b-df8b-4005-8a24-4c2e4cbf5519 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:05.691898 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fa31b-df8b-4005-8a24-4c2e4cbf5519 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:05.722801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:05.740487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab163b1-b2e1-40e0-b946-90e2bfd86511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:05.741120 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab163b1-b2e1-40e0-b946-90e2bfd86511 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:05.741400 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab163b1-b2e1-40e0-b946-90e2bfd86511 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:05.741675 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab163b1-b2e1-40e0-b946-90e2bfd86511 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:05.742358 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab163b1-b2e1-40e0-b946-90e2bfd86511 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:05.742660 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab163b1-b2e1-40e0-b946-90e2bfd86511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:05.744113 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab163b1-b2e1-40e0-b946-90e2bfd86511 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:05.756773 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 432/871] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:10:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:05.762730 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b09a8-3693-49b0-b4d6-5eeef4145a56 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:05.858480 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:05.885472 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b09a8-3693-49b0-b4d6-5eeef4145a56 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:05.924641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99103a6-a90b-410e-b025-711b9fb7a129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:05.925292 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99103a6-a90b-410e-b025-711b9fb7a129 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:05.925575 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99103a6-a90b-410e-b025-711b9fb7a129 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:05.925854 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99103a6-a90b-410e-b025-711b9fb7a129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:05.936957 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99103a6-a90b-410e-b025-711b9fb7a129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:05.938430 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99103a6-a90b-410e-b025-711b9fb7a129 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-a99103a6-a90b-410e-b025-711b9fb7a129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:05.955008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:05.957052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:05.957940 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:05.957940 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:05.957940 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:05.957940 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 440/872] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:05.962667 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab163b1-b2e1-40e0-b946-90e2bfd86511 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:06.071346 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab163b1-b2e1-40e0-b946-90e2bfd86511 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:06.107628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edc88f-9494-4b93-9662-6afc1f137488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:06.108281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc88f-9494-4b93-9662-6afc1f137488 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:06.108617 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc88f-9494-4b93-9662-6afc1f137488 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:06.108838 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc88f-9494-4b93-9662-6afc1f137488 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:06.109491 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edc88f-9494-4b93-9662-6afc1f137488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:06.109794 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edc88f-9494-4b93-9662-6afc1f137488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:06.111742 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edc88f-9494-4b93-9662-6afc1f137488 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:06.124655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 433/873] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:06.131374 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99103a6-a90b-410e-b025-711b9fb7a129 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:06.235192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99103a6-a90b-410e-b025-711b9fb7a129 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:06.263441 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:06.271979 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405a3ba-dae7-4874-bc49-51331e17d33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:06.272829 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405a3ba-dae7-4874-bc49-51331e17d33b None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:06.273256 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405a3ba-dae7-4874-bc49-51331e17d33b None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:06.273679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405a3ba-dae7-4874-bc49-51331e17d33b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:06.281406 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405a3ba-dae7-4874-bc49-51331e17d33b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:06.282838 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405a3ba-dae7-4874-bc49-51331e17d33b None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-c405a3ba-dae7-4874-bc49-51331e17d33b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:10:06.295280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:06.296312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:06.297255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:06.297255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:06.297255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:10:06.297255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:10:06.297255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:10:06.297255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:10:06.297255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:10:06.297255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:10:06.297255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:10:06.297255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:06.297255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 441/874] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:06.303330 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edc88f-9494-4b93-9662-6afc1f137488 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:06.356840 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:06.409741 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edc88f-9494-4b93-9662-6afc1f137488 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:06.445765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a3ff9-9f6d-45e3-aa37-18a6fc9ed7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:06.446372 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a3ff9-9f6d-45e3-aa37-18a6fc9ed7dd None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:06.446655 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a3ff9-9f6d-45e3-aa37-18a6fc9ed7dd None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:06.446927 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a3ff9-9f6d-45e3-aa37-18a6fc9ed7dd None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:06.447646 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a3ff9-9f6d-45e3-aa37-18a6fc9ed7dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:06.447995 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a3ff9-9f6d-45e3-aa37-18a6fc9ed7dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:06.449420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a3ff9-9f6d-45e3-aa37-18a6fc9ed7dd None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:06.466176 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 434/875] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Aug 23 22:10:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:06.472704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405a3ba-dae7-4874-bc49-51331e17d33b None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:06.570639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405a3ba-dae7-4874-bc49-51331e17d33b None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:06.603935 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2ae8b-68bc-4536-90d3-578f911868d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:06.604530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2ae8b-68bc-4536-90d3-578f911868d7 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:06.604811 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2ae8b-68bc-4536-90d3-578f911868d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:06.605087 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2ae8b-68bc-4536-90d3-578f911868d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:06.659234 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:06.674183 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2ae8b-68bc-4536-90d3-578f911868d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:06.675578 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2ae8b-68bc-4536-90d3-578f911868d7 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:06.773176 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 442/876] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:06 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:10:06.778984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a3ff9-9f6d-45e3-aa37-18a6fc9ed7dd None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:06.887652 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a3ff9-9f6d-45e3-aa37-18a6fc9ed7dd None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:06.896925 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:06.922196 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fbb5d-05ba-4514-8a05-606346d54508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:06.922822 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fbb5d-05ba-4514-8a05-606346d54508 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:06.923102 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fbb5d-05ba-4514-8a05-606346d54508 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:06.923375 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fbb5d-05ba-4514-8a05-606346d54508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:06.934152 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fbb5d-05ba-4514-8a05-606346d54508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:06.935592 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fbb5d-05ba-4514-8a05-606346d54508 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-d47fbb5d-05ba-4514-8a05-606346d54508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:06.950440 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:06.951551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:06.952509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:06.952509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:06.952509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:06.952509 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 435/877] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:06.958063 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2ae8b-68bc-4536-90d3-578f911868d7 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:07.042648 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:07.054800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2ae8b-68bc-4536-90d3-578f911868d7 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:07.087575 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c942812-43ff-444e-b99e-bcbc00b999bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:07.088193 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c942812-43ff-444e-b99e-bcbc00b999bb None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:07.088474 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c942812-43ff-444e-b99e-bcbc00b999bb None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:07.088743 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c942812-43ff-444e-b99e-bcbc00b999bb None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:07.089377 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c942812-43ff-444e-b99e-bcbc00b999bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:07.089679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c942812-43ff-444e-b99e-bcbc00b999bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:07.091038 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c942812-43ff-444e-b99e-bcbc00b999bb None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:07.102962 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 443/878] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:07.108600 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fbb5d-05ba-4514-8a05-606346d54508 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:07.206533 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fbb5d-05ba-4514-8a05-606346d54508 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:07.239881 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8e314-1070-448f-b3ea-7eb244285d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:07.240520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8e314-1070-448f-b3ea-7eb244285d33 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:07.240805 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8e314-1070-448f-b3ea-7eb244285d33 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:07.241085 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8e314-1070-448f-b3ea-7eb244285d33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:07.247651 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8e314-1070-448f-b3ea-7eb244285d33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:07.249167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8e314-1070-448f-b3ea-7eb244285d33 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-11d8e314-1070-448f-b3ea-7eb244285d33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:10:07.260908 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:07.261911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:07.262829 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:10:07.262829 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:10:07.262829 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:10:07.262829 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:10:07.262829 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:10:07.262829 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:10:07.262829 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:07.262829 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:07.262829 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 436/879] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:10:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:07.268564 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c942812-43ff-444e-b99e-bcbc00b999bb None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:07.366558 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c942812-43ff-444e-b99e-bcbc00b999bb None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:07.399914 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608dc01-61dc-481d-b17f-334f89cc3748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:07.400506 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608dc01-61dc-481d-b17f-334f89cc3748 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:07.400787 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608dc01-61dc-481d-b17f-334f89cc3748 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:07.401059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608dc01-61dc-481d-b17f-334f89cc3748 None admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:07.401737 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608dc01-61dc-481d-b17f-334f89cc3748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:07.402045 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608dc01-61dc-481d-b17f-334f89cc3748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:07.403466 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608dc01-61dc-481d-b17f-334f89cc3748 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:07.415080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 444/880] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:10:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:07.421113 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8e314-1070-448f-b3ea-7eb244285d33 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:07.443549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:07.520923 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8e314-1070-448f-b3ea-7eb244285d33 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:07.555468 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187d8a8-390b-46b7-9506-bcbb71eb8f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:07.556102 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187d8a8-390b-46b7-9506-bcbb71eb8f41 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:07.556384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187d8a8-390b-46b7-9506-bcbb71eb8f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:07.556656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187d8a8-390b-46b7-9506-bcbb71eb8f41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:07.557375 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187d8a8-390b-46b7-9506-bcbb71eb8f41 None admin] RBAC: Adding query filter params (role.id=81a7cb1c95fd45708dbee5e4dc91626b, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=7a55d53b8c1a4dffa00b9114d1df498a) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:07.557678 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187d8a8-390b-46b7-9506-bcbb71eb8f41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:07.559098 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187d8a8-390b-46b7-9506-bcbb71eb8f41 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:07.565248 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 437/881] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:10:07 2022] GET /identity/v3/role_assignments?user.id=7a55d53b8c1a4dffa00b9114d1df498a&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=81a7cb1c95fd45708dbee5e4dc91626b => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:09.769113 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb16e4f-641d-425e-9c7f-bfae5dcae673 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:09.769664 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb16e4f-641d-425e-9c7f-bfae5dcae673 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:09.769664 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb16e4f-641d-425e-9c7f-bfae5dcae673 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:09.770972 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 445/882] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:09.776177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8410-747f-46a3-95b6-d1589b7ee71a None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:09.776563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8410-747f-46a3-95b6-d1589b7ee71a None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:09.776762 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8410-747f-46a3-95b6-d1589b7ee71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:09.795068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-732b8410-747f-46a3-95b6-d1589b7ee71a None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:09.796287 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-732b8410-747f-46a3-95b6-d1589b7ee71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:09.871513 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 438/883] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:09 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:10.204777 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb16e4f-641d-425e-9c7f-bfae5dcae673 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:10.215695 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:10.308852 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb16e4f-641d-425e-9c7f-bfae5dcae673 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:10.341539 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d669f-d580-41d9-b0e6-214c3a4ae151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:10.342153 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d669f-d580-41d9-b0e6-214c3a4ae151 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:10.342432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d669f-d580-41d9-b0e6-214c3a4ae151 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:10.342703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d669f-d580-41d9-b0e6-214c3a4ae151 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:10.353641 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d669f-d580-41d9-b0e6-214c3a4ae151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-9d0d669f-d580-41d9-b0e6-214c3a4ae151 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:10:10.358306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:10.359402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:10.360304 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 446/884] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:10:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:10.366206 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b8410-747f-46a3-95b6-d1589b7ee71a None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:10.381681 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:10.470059 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b8410-747f-46a3-95b6-d1589b7ee71a None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:10.503402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08900d-ebaf-40a6-ba58-ad198a4975e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:10.504052 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08900d-ebaf-40a6-ba58-ad198a4975e0 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:10.504334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08900d-ebaf-40a6-ba58-ad198a4975e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:10.504609 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08900d-ebaf-40a6-ba58-ad198a4975e0 None admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:10.505273 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08900d-ebaf-40a6-ba58-ad198a4975e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:10.505581 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08900d-ebaf-40a6-ba58-ad198a4975e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:10.506953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08900d-ebaf-40a6-ba58-ad198a4975e0 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:10.514871 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 439/885] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:10:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:10.521378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d669f-d580-41d9-b0e6-214c3a4ae151 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:10.587624 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:10.621128 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d669f-d580-41d9-b0e6-214c3a4ae151 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:10.657702 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93b1c7-7ae2-4d68-bc4c-1b30ef544790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:10.658347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93b1c7-7ae2-4d68-bc4c-1b30ef544790 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:10.658626 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93b1c7-7ae2-4d68-bc4c-1b30ef544790 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:10.658899 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93b1c7-7ae2-4d68-bc4c-1b30ef544790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:10.668710 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93b1c7-7ae2-4d68-bc4c-1b30ef544790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:10.670144 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93b1c7-7ae2-4d68-bc4c-1b30ef544790 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-eb93b1c7-7ae2-4d68-bc4c-1b30ef544790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:10.684714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:10.685808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:10.686810 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:10.686810 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:10.686810 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:10.686810 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 447/886] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:10.692160 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08900d-ebaf-40a6-ba58-ad198a4975e0 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:10.777714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:10.801221 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08900d-ebaf-40a6-ba58-ad198a4975e0 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:10.840027 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e9217-928f-41da-a549-c420868ff225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:10.840835 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e9217-928f-41da-a549-c420868ff225 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:10.841190 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e9217-928f-41da-a549-c420868ff225 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:10.841532 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e9217-928f-41da-a549-c420868ff225 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:10.842349 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e9217-928f-41da-a549-c420868ff225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:10.842708 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e9217-928f-41da-a549-c420868ff225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:10.844789 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e9217-928f-41da-a549-c420868ff225 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:10.857396 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 440/887] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:10.863760 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93b1c7-7ae2-4d68-bc4c-1b30ef544790 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:10.961152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93b1c7-7ae2-4d68-bc4c-1b30ef544790 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:10.981408 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:10.996169 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ccde7-3ad2-4205-8959-40b277103b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:10.996793 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ccde7-3ad2-4205-8959-40b277103b65 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:10.997072 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ccde7-3ad2-4205-8959-40b277103b65 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:10.997345 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ccde7-3ad2-4205-8959-40b277103b65 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:11.005005 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ccde7-3ad2-4205-8959-40b277103b65 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:11.006483 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ccde7-3ad2-4205-8959-40b277103b65 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-6e8ccde7-3ad2-4205-8959-40b277103b65 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:10:11.017363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:11.019002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:11.020080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:11.020080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:11.020080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:10:11.020080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:10:11.020080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:10:11.020080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:10:11.020080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:10:11.020080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:10:11.020080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:10:11.020080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:11.020080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 448/888] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:11.024402 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e9217-928f-41da-a549-c420868ff225 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:11.122061 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e9217-928f-41da-a549-c420868ff225 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:11.154912 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbae95-6538-47cf-9733-708053d47ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:11.155503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbae95-6538-47cf-9733-708053d47ea0 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:11.155779 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbae95-6538-47cf-9733-708053d47ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:11.156071 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbae95-6538-47cf-9733-708053d47ea0 None admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:11.156779 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbae95-6538-47cf-9733-708053d47ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:11.157073 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbae95-6538-47cf-9733-708053d47ea0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:11.158483 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbae95-6538-47cf-9733-708053d47ea0 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:11.161001 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:11.175205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 441/889] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Aug 23 22:10:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:11.180819 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ccde7-3ad2-4205-8959-40b277103b65 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:11.281112 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ccde7-3ad2-4205-8959-40b277103b65 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:11.313901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07f48b-3600-4060-b673-c2f87e39c336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:11.314518 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07f48b-3600-4060-b673-c2f87e39c336 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:11.314799 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07f48b-3600-4060-b673-c2f87e39c336 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:11.315648 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07f48b-3600-4060-b673-c2f87e39c336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:11.325865 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07f48b-3600-4060-b673-c2f87e39c336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:11.327303 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07f48b-3600-4060-b673-c2f87e39c336 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-9f07f48b-3600-4060-b673-c2f87e39c336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:11.341049 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:11.342145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:11.348216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:11.348216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:11.348216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:11.348216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 449/890] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:11.348511 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbae95-6538-47cf-9733-708053d47ea0 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:11.448194 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbae95-6538-47cf-9733-708053d47ea0 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:11.482924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd999a-4e4b-4fe6-8875-c2c0cad64475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:11.483514 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd999a-4e4b-4fe6-8875-c2c0cad64475 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:11.483793 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd999a-4e4b-4fe6-8875-c2c0cad64475 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:11.484094 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd999a-4e4b-4fe6-8875-c2c0cad64475 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:11.484720 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd999a-4e4b-4fe6-8875-c2c0cad64475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:11.485017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd999a-4e4b-4fe6-8875-c2c0cad64475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:11.486387 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd999a-4e4b-4fe6-8875-c2c0cad64475 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:11.497445 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 442/891] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:11.503750 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07f48b-3600-4060-b673-c2f87e39c336 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:11.536396 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:11.605871 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07f48b-3600-4060-b673-c2f87e39c336 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:11.640110 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5ce85-3567-4e96-b7ba-8f8580bedec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:11.640727 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5ce85-3567-4e96-b7ba-8f8580bedec2 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:11.641010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5ce85-3567-4e96-b7ba-8f8580bedec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:11.641284 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5ce85-3567-4e96-b7ba-8f8580bedec2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:11.647914 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5ce85-3567-4e96-b7ba-8f8580bedec2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:11.649371 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5ce85-3567-4e96-b7ba-8f8580bedec2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-6af5ce85-3567-4e96-b7ba-8f8580bedec2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:10:11.660863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:11.661732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:11.662639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:10:11.662639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:10:11.662639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:10:11.662639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:10:11.662639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:10:11.662639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:10:11.662639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:11.662639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:11.662639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 450/892] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:10:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:11.667796 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd999a-4e4b-4fe6-8875-c2c0cad64475 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:11.723350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:11.767525 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd999a-4e4b-4fe6-8875-c2c0cad64475 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:11.801471 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255177e8-409a-4125-b12f-c7378ee406f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:11.802053 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255177e8-409a-4125-b12f-c7378ee406f2 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:11.802333 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255177e8-409a-4125-b12f-c7378ee406f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:11.802604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255177e8-409a-4125-b12f-c7378ee406f2 None admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:11.803286 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255177e8-409a-4125-b12f-c7378ee406f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:11.803589 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255177e8-409a-4125-b12f-c7378ee406f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:11.805052 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255177e8-409a-4125-b12f-c7378ee406f2 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:11.818397 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 443/893] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:10:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:11.824721 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5ce85-3567-4e96-b7ba-8f8580bedec2 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:11.916906 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:11.926503 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5ce85-3567-4e96-b7ba-8f8580bedec2 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:11.960282 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fa274-7a05-41c8-a315-2b95106b85e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:11.960933 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fa274-7a05-41c8-a315-2b95106b85e2 None admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:11.961216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fa274-7a05-41c8-a315-2b95106b85e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:11.961492 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fa274-7a05-41c8-a315-2b95106b85e2 None admin] PATH_INFO: `/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/7a55d53b8c1a4dffa00b9114d1df498a/roles/81a7cb1c95fd45708dbee5e4dc91626b` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:11.963389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fa274-7a05-41c8-a315-2b95106b85e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d86eb186aa94e1bb4a358cfc19447b1, user_id=7a55d53b8c1a4dffa00b9114d1df498a, role_id=81a7cb1c95fd45708dbee5e4dc91626b)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:11.964853 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fa274-7a05-41c8-a315-2b95106b85e2 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:11.978487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 451/894] 10.222.0.58 () {58 vars in 1439 bytes} [Tue Aug 23 22:10:11 2022] PUT /identity/v3/projects/0d86eb186aa94e1bb4a358cfc19447b1/users/7a55d53b8c1a4dffa00b9114d1df498a/roles/81a7cb1c95fd45708dbee5e4dc91626b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:10:14.137238 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c245-dc24-41c4-a508-aad1d6b4533d None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:14.137766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c245-dc24-41c4-a508-aad1d6b4533d None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:14.137766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8c245-dc24-41c4-a508-aad1d6b4533d None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:14.139082 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 444/895] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:14.145920 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb6f65-ade3-4ce7-845f-967b7b2fe7c7 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:14.146349 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb6f65-ade3-4ce7-845f-967b7b2fe7c7 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:14.146714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb6f65-ade3-4ce7-845f-967b7b2fe7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:14.164889 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-f1cb6f65-ade3-4ce7-845f-967b7b2fe7c7 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:14.166081 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-f1cb6f65-ade3-4ce7-845f-967b7b2fe7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:14.231089 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 452/896] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:14 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:14.554662 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8c245-dc24-41c4-a508-aad1d6b4533d None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:14.654386 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e8c245-dc24-41c4-a508-aad1d6b4533d None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:14.668947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:14.689376 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff090d5-697b-4d8e-891e-507d8748f582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:14.690554 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff090d5-697b-4d8e-891e-507d8748f582 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:14.690990 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff090d5-697b-4d8e-891e-507d8748f582 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:14.691294 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff090d5-697b-4d8e-891e-507d8748f582 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:14.701002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff090d5-697b-4d8e-891e-507d8748f582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-eff090d5-697b-4d8e-891e-507d8748f582 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 22:10:14.706242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:14.707297 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:14.708515 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 445/897] 10.222.0.58 () {56 vars in 1096 bytes} [Tue Aug 23 22:10:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:14.713269 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb6f65-ade3-4ce7-845f-967b7b2fe7c7 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:14.792274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:14.811874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb6f65-ade3-4ce7-845f-967b7b2fe7c7 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:14.852419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65122981-baa1-4dce-ae66-254e4320ec3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:14.853132 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65122981-baa1-4dce-ae66-254e4320ec3c None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:14.853510 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65122981-baa1-4dce-ae66-254e4320ec3c None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:14.853859 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65122981-baa1-4dce-ae66-254e4320ec3c None admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:14.854674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65122981-baa1-4dce-ae66-254e4320ec3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:14.855052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65122981-baa1-4dce-ae66-254e4320ec3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:14.856754 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65122981-baa1-4dce-ae66-254e4320ec3c None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:14.866991 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 453/898] 10.222.0.58 () {56 vars in 1099 bytes} [Tue Aug 23 22:10:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:14.873482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff090d5-697b-4d8e-891e-507d8748f582 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:14.973295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff090d5-697b-4d8e-891e-507d8748f582 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:15.006847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71c506-b750-4349-8cf4-df68a6645690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:15.007470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c506-b750-4349-8cf4-df68a6645690 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:15.007751 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c506-b750-4349-8cf4-df68a6645690 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:15.008055 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c506-b750-4349-8cf4-df68a6645690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:15.017827 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71c506-b750-4349-8cf4-df68a6645690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:15.019854 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71c506-b750-4349-8cf4-df68a6645690 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-1a71c506-b750-4349-8cf4-df68a6645690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:15.033825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:15.034957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:15.036085 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:15.036085 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:15.036085 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:15.036085 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 446/899] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:15.040975 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65122981-baa1-4dce-ae66-254e4320ec3c None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:15.142761 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65122981-baa1-4dce-ae66-254e4320ec3c None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:15.176301 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4eedec-0751-4047-85ce-ede507861a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:15.176897 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eedec-0751-4047-85ce-ede507861a7b None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:15.177177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eedec-0751-4047-85ce-ede507861a7b None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:15.177450 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eedec-0751-4047-85ce-ede507861a7b None admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:15.178078 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4eedec-0751-4047-85ce-ede507861a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:15.178376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4eedec-0751-4047-85ce-ede507861a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:15.179764 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4eedec-0751-4047-85ce-ede507861a7b None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:15.192030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 454/900] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:15.197802 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71c506-b750-4349-8cf4-df68a6645690 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:15.225707 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:15.299749 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71c506-b750-4349-8cf4-df68a6645690 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:15.334274 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ed24c-eced-4981-b95c-ca65e3971f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:15.334902 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ed24c-eced-4981-b95c-ca65e3971f52 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:15.335186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ed24c-eced-4981-b95c-ca65e3971f52 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:15.335490 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ed24c-eced-4981-b95c-ca65e3971f52 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:15.343566 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ed24c-eced-4981-b95c-ca65e3971f52 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:15.345975 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ed24c-eced-4981-b95c-ca65e3971f52 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-ef4ed24c-eced-4981-b95c-ca65e3971f52 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 22:10:15.360350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:15.361477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:15.362999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:15.362999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:15.362999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 22:10:15.362999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 22:10:15.362999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 22:10:15.362999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 22:10:15.362999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 22:10:15.362999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 22:10:15.362999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 22:10:15.362999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:15.362999 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 447/901] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:15.368260 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4eedec-0751-4047-85ce-ede507861a7b None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:15.372085 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:15.465771 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4eedec-0751-4047-85ce-ede507861a7b None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:15.499531 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b4e7f-e289-4f7b-9865-3bfc21e9c96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:15.500161 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b4e7f-e289-4f7b-9865-3bfc21e9c96f None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:15.500442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b4e7f-e289-4f7b-9865-3bfc21e9c96f None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:15.500718 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b4e7f-e289-4f7b-9865-3bfc21e9c96f None admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:15.501432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b4e7f-e289-4f7b-9865-3bfc21e9c96f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:15.501739 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b4e7f-e289-4f7b-9865-3bfc21e9c96f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:15.503217 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b4e7f-e289-4f7b-9865-3bfc21e9c96f None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:15.520097 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 455/902] 10.222.0.58 () {56 vars in 1143 bytes} [Tue Aug 23 22:10:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:15.525759 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ed24c-eced-4981-b95c-ca65e3971f52 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:15.609367 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:15.624461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ed24c-eced-4981-b95c-ca65e3971f52 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:15.664927 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606f233-1478-4c36-8adb-645f1b7f72bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:15.665527 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606f233-1478-4c36-8adb-645f1b7f72bd None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:15.665807 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606f233-1478-4c36-8adb-645f1b7f72bd None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:15.666082 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606f233-1478-4c36-8adb-645f1b7f72bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:15.732048 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606f233-1478-4c36-8adb-645f1b7f72bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:15.733422 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606f233-1478-4c36-8adb-645f1b7f72bd None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:15.816522 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:15.832170 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 448/903] 10.222.0.58 () {58 vars in 1282 bytes} [Tue Aug 23 22:10:15 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 22:10:15.838165 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b4e7f-e289-4f7b-9865-3bfc21e9c96f None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:15.898082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:15.935396 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b4e7f-e289-4f7b-9865-3bfc21e9c96f None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:15.969528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f86e1-2bcc-4b80-b426-d2cc3b5ec72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:15.970136 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f86e1-2bcc-4b80-b426-d2cc3b5ec72a None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:15.970411 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f86e1-2bcc-4b80-b426-d2cc3b5ec72a None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:15.970680 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f86e1-2bcc-4b80-b426-d2cc3b5ec72a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:15.980719 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f86e1-2bcc-4b80-b426-d2cc3b5ec72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:15.982222 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f86e1-2bcc-4b80-b426-d2cc3b5ec72a None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-a49f86e1-2bcc-4b80-b426-d2cc3b5ec72a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 22:10:15.997313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:15.998305 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 22:10:15.999347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 22:10:15.999347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 22:10:15.999347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:15.999347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 456/904] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:16.005283 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606f233-1478-4c36-8adb-645f1b7f72bd None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:16.101771 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606f233-1478-4c36-8adb-645f1b7f72bd None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:16.134283 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e042e-d55a-45ca-b867-313153423794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:16.134878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e042e-d55a-45ca-b867-313153423794 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:16.135155 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e042e-d55a-45ca-b867-313153423794 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:16.135421 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e042e-d55a-45ca-b867-313153423794 None admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:16.136073 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e042e-d55a-45ca-b867-313153423794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:16.136372 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e042e-d55a-45ca-b867-313153423794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:16.137722 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e042e-d55a-45ca-b867-313153423794 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:16.149023 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 449/905] 10.222.0.58 () {56 vars in 1109 bytes} [Tue Aug 23 22:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:16.154662 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f86e1-2bcc-4b80-b426-d2cc3b5ec72a None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:16.254413 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f86e1-2bcc-4b80-b426-d2cc3b5ec72a None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:16.268863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:16.289844 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc0267-3980-45fc-8670-bd53f212cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:16.290467 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc0267-3980-45fc-8670-bd53f212cb08 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:16.290751 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc0267-3980-45fc-8670-bd53f212cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:16.291028 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc0267-3980-45fc-8670-bd53f212cb08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:16.297531 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc0267-3980-45fc-8670-bd53f212cb08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:16.298966 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc0267-3980-45fc-8670-bd53f212cb08 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application [None req-42fc0267-3980-45fc-8670-bd53f212cb08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 22:10:16.311050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:16.312149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:16.313184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 22:10:16.313184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 22:10:16.313184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 22:10:16.313184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 22:10:16.313184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 22:10:16.313184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 22:10:16.313184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 22:10:16.313184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: ERROR keystone.server.flask.application Aug 23 22:10:16.313184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 457/906] 10.222.0.58 () {56 vars in 1111 bytes} [Tue Aug 23 22:10:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:16.318839 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e042e-d55a-45ca-b867-313153423794 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:16.364624 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:16.416304 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e042e-d55a-45ca-b867-313153423794 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:16.449352 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8053b-288a-47a7-8832-f9e547306fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:16.449948 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8053b-288a-47a7-8832-f9e547306fb6 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:16.450226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8053b-288a-47a7-8832-f9e547306fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:16.450494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8053b-288a-47a7-8832-f9e547306fb6 None admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:16.451167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8053b-288a-47a7-8832-f9e547306fb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:16.451466 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8053b-288a-47a7-8832-f9e547306fb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:16.452911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8053b-288a-47a7-8832-f9e547306fb6 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:16.465037 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 450/907] 10.222.0.58 () {56 vars in 1148 bytes} [Tue Aug 23 22:10:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:16.471767 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc0267-3980-45fc-8670-bd53f212cb08 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:16.569201 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc0267-3980-45fc-8670-bd53f212cb08 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:16.602688 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c965b5-6f9b-4cc4-9248-d1d6dea7e916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:16.603280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c965b5-6f9b-4cc4-9248-d1d6dea7e916 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:16.603563 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c965b5-6f9b-4cc4-9248-d1d6dea7e916 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:16.603856 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c965b5-6f9b-4cc4-9248-d1d6dea7e916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:16.604572 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c965b5-6f9b-4cc4-9248-d1d6dea7e916 None admin] RBAC: Adding query filter params (role.id=81a7cb1c95fd45708dbee5e4dc91626b, scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1, user.id=7a55d53b8c1a4dffa00b9114d1df498a) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:16.604880 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c965b5-6f9b-4cc4-9248-d1d6dea7e916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:16.606312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c965b5-6f9b-4cc4-9248-d1d6dea7e916 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:16.611931 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 458/908] 10.222.0.58 () {56 vars in 1374 bytes} [Tue Aug 23 22:10:16 2022] GET /identity/v3/role_assignments?user.id=7a55d53b8c1a4dffa00b9114d1df498a&scope.project.id=0d86eb186aa94e1bb4a358cfc19447b1&role.id=81a7cb1c95fd45708dbee5e4dc91626b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:18.834547 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a25a1-d553-4b4b-bd7d-ad58f301d5fc None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:18.835087 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a25a1-d553-4b4b-bd7d-ad58f301d5fc None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:18.835087 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a25a1-d553-4b4b-bd7d-ad58f301d5fc None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:18.836487 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 451/909] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:18.842889 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287f6fa-7952-4964-936b-f011f8760b58 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:18.843441 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287f6fa-7952-4964-936b-f011f8760b58 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:18.843625 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287f6fa-7952-4964-936b-f011f8760b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:18.865667 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-5287f6fa-7952-4964-936b-f011f8760b58 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:18.866969 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-5287f6fa-7952-4964-936b-f011f8760b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:18.898050 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:18.934229 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 459/910] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:18 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:19.262055 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a25a1-d553-4b4b-bd7d-ad58f301d5fc None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:19.368760 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a25a1-d553-4b4b-bd7d-ad58f301d5fc None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:19.376918 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:19.405092 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6de89-52b8-4c34-beb2-3df925b98795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:19.405715 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6de89-52b8-4c34-beb2-3df925b98795 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:19.406003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6de89-52b8-4c34-beb2-3df925b98795 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:19.406280 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6de89-52b8-4c34-beb2-3df925b98795 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:19.406851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6de89-52b8-4c34-beb2-3df925b98795 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:19.408249 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6de89-52b8-4c34-beb2-3df925b98795 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-68f6de89-52b8-4c34-beb2-3df925b98795 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:19.416984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:19.418024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:19.418878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 452/911] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Aug 23 22:10:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:19.424145 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287f6fa-7952-4964-936b-f011f8760b58 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:19.522314 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287f6fa-7952-4964-936b-f011f8760b58 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:19.555297 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2ee38-bab1-4a84-ad2f-947eecf89c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:19.555918 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2ee38-bab1-4a84-ad2f-947eecf89c2d None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:19.556196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2ee38-bab1-4a84-ad2f-947eecf89c2d None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:19.556463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2ee38-bab1-4a84-ad2f-947eecf89c2d None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:19.557076 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2ee38-bab1-4a84-ad2f-947eecf89c2d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:19.557373 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2ee38-bab1-4a84-ad2f-947eecf89c2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:19.558733 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2ee38-bab1-4a84-ad2f-947eecf89c2d None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:19.563280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 460/912] 10.222.0.58 () {56 vars in 1116 bytes} [Tue Aug 23 22:10:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:19.569873 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6de89-52b8-4c34-beb2-3df925b98795 None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:19.673036 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6de89-52b8-4c34-beb2-3df925b98795 None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:19.711467 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbbbd4-e0fb-45d5-8f82-936372ae5c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:19.712550 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbbbd4-e0fb-45d5-8f82-936372ae5c49 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:19.713051 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbbbd4-e0fb-45d5-8f82-936372ae5c49 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:19.713350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbbbd4-e0fb-45d5-8f82-936372ae5c49 None admin] PATH_INFO: `/v3/services` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:19.713987 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbbbd4-e0fb-45d5-8f82-936372ae5c49 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:19.714295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbbbd4-e0fb-45d5-8f82-936372ae5c49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:19.715683 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbbbd4-e0fb-45d5-8f82-936372ae5c49 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:19.722693 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 453/913] 10.222.0.58 () {56 vars in 1116 bytes} [Tue Aug 23 22:10:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:21.964313 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611abeb3-17d6-4af5-b589-d3dab7acd84d None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:21.964850 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611abeb3-17d6-4af5-b589-d3dab7acd84d None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:21.964850 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611abeb3-17d6-4af5-b589-d3dab7acd84d None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:21.966224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 461/914] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:21.973319 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a82c71-cd0b-441a-a857-27acc0322ad1 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:21.973813 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a82c71-cd0b-441a-a857-27acc0322ad1 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:21.973907 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a82c71-cd0b-441a-a857-27acc0322ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:21.993746 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-a0a82c71-cd0b-441a-a857-27acc0322ad1 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:21.994944 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-a0a82c71-cd0b-441a-a857-27acc0322ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:22.023971 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:22.082408 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 454/915] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:21 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:22.503003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611abeb3-17d6-4af5-b589-d3dab7acd84d None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:22.534677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:22.604612 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611abeb3-17d6-4af5-b589-d3dab7acd84d None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:22.640379 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d072b5-864b-4f51-933a-e6a1ebac32b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:22.640977 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d072b5-864b-4f51-933a-e6a1ebac32b1 None admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:22.641257 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d072b5-864b-4f51-933a-e6a1ebac32b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:22.641536 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d072b5-864b-4f51-933a-e6a1ebac32b1 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:22.642179 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d072b5-864b-4f51-933a-e6a1ebac32b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:22.643573 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d072b5-864b-4f51-933a-e6a1ebac32b1 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:22.657671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 462/916] 10.222.0.58 () {60 vars in 1141 bytes} [Tue Aug 23 22:10:22 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:10:24.841426 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfbd4e-ff50-4040-8d72-1de6740ce981 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:24.841962 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfbd4e-ff50-4040-8d72-1de6740ce981 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:24.841962 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfbd4e-ff50-4040-8d72-1de6740ce981 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:24.843280 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 455/917] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:24.848849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd25a84-516b-4af2-a363-529a147234b1 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:24.849226 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd25a84-516b-4af2-a363-529a147234b1 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:24.849398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd25a84-516b-4af2-a363-529a147234b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:24.867529 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-9bd25a84-516b-4af2-a363-529a147234b1 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:24.868741 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-9bd25a84-516b-4af2-a363-529a147234b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:24.938510 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 463/918] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:24 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:25.269180 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfbd4e-ff50-4040-8d72-1de6740ce981 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:25.369007 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfbd4e-ff50-4040-8d72-1de6740ce981 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:25.402577 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d601f-96f2-4299-8403-5b6ad555429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:25.403195 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d601f-96f2-4299-8403-5b6ad555429f None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:25.403476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d601f-96f2-4299-8403-5b6ad555429f None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:25.403753 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d601f-96f2-4299-8403-5b6ad555429f None admin] PATH_INFO: `/v3/services/placement` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:25.404358 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d601f-96f2-4299-8403-5b6ad555429f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:25.405755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d601f-96f2-4299-8403-5b6ad555429f None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-d75d601f-96f2-4299-8403-5b6ad555429f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:25.414797 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:25.415953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:25.416947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 456/919] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Aug 23 22:10:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:25.421835 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd25a84-516b-4af2-a363-529a147234b1 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:25.440225 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:25.520178 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd25a84-516b-4af2-a363-529a147234b1 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:25.553464 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994971ab-73e3-4516-830a-b0e7b93558a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:25.554054 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994971ab-73e3-4516-830a-b0e7b93558a7 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:25.554332 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994971ab-73e3-4516-830a-b0e7b93558a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:25.554605 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994971ab-73e3-4516-830a-b0e7b93558a7 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:25.555224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994971ab-73e3-4516-830a-b0e7b93558a7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:25.555530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994971ab-73e3-4516-830a-b0e7b93558a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:25.556930 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994971ab-73e3-4516-830a-b0e7b93558a7 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:25.561762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 464/920] 10.222.0.58 () {56 vars in 1116 bytes} [Tue Aug 23 22:10:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:10:25.568433 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d601f-96f2-4299-8403-5b6ad555429f None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:25.597153 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:25.671093 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d601f-96f2-4299-8403-5b6ad555429f None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:25.703776 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9603c-95e4-4891-9256-870cd8cedf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:25.704407 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9603c-95e4-4891-9256-870cd8cedf88 None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:25.704694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9603c-95e4-4891-9256-870cd8cedf88 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:25.704970 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9603c-95e4-4891-9256-870cd8cedf88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:25.706199 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9603c-95e4-4891-9256-870cd8cedf88 None admin] RBAC: Adding query filter params (interface=public, service_id=58db29cc689d4228b0d63c26cd457124, region_id=RegionOne) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:25.706501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9603c-95e4-4891-9256-870cd8cedf88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:25.707886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9603c-95e4-4891-9256-870cd8cedf88 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:25.712851 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 457/921] 10.222.0.58 () {56 vars in 1251 bytes} [Tue Aug 23 22:10:25 2022] GET /identity/v3/endpoints?service_id=58db29cc689d4228b0d63c26cd457124&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:25.718632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994971ab-73e3-4516-830a-b0e7b93558a7 None admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:25.798514 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:25.816053 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994971ab-73e3-4516-830a-b0e7b93558a7 None admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:25.849664 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea50afd-1131-4060-a255-f2b3ce16e7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:25.850254 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea50afd-1131-4060-a255-f2b3ce16e7f1 None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:25.850528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea50afd-1131-4060-a255-f2b3ce16e7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:25.850791 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea50afd-1131-4060-a255-f2b3ce16e7f1 None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:25.851376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea50afd-1131-4060-a255-f2b3ce16e7f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:25.852764 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea50afd-1131-4060-a255-f2b3ce16e7f1 None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:25.859009 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 465/922] 10.222.0.58 () {56 vars in 1087 bytes} [Tue Aug 23 22:10:25 2022] GET /identity/v3/services => generated 1962 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:10:28.013985 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437266c4-d530-48df-ac43-40a4d3bed950 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:28.014549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437266c4-d530-48df-ac43-40a4d3bed950 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:28.014549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437266c4-d530-48df-ac43-40a4d3bed950 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:28.015856 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 458/923] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:10:28.021413 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef9ac8-31ef-4e35-a6b4-a1cde37a43e7 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:28.021812 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef9ac8-31ef-4e35-a6b4-a1cde37a43e7 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:28.021963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef9ac8-31ef-4e35-a6b4-a1cde37a43e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:28.040224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-bbef9ac8-31ef-4e35-a6b4-a1cde37a43e7 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:10:28.041443 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-bbef9ac8-31ef-4e35-a6b4-a1cde37a43e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:10:28.111017 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 466/924] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:10:28 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 22:10:28.437589 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437266c4-d530-48df-ac43-40a4d3bed950 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:28.529196 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:28.539217 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437266c4-d530-48df-ac43-40a4d3bed950 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:28.572765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475107b-66b7-4930-860a-8f397872fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:28.573380 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475107b-66b7-4930-860a-8f397872fcaf None admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:28.573657 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475107b-66b7-4930-860a-8f397872fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:28.573927 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475107b-66b7-4930-860a-8f397872fcaf None admin] PATH_INFO: `/v3/services/placement` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:28.574489 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475107b-66b7-4930-860a-8f397872fcaf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:28.575862 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475107b-66b7-4930-860a-8f397872fcaf None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application [None req-6475107b-66b7-4930-860a-8f397872fcaf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 22:10:28.584309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 22:10:28.585448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application with Lock( Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self._enter() Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application return self.creator() Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application created_value = creator( Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: ERROR keystone.server.flask.application Aug 23 22:10:28.586602 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 459/925] 10.222.0.58 () {56 vars in 1117 bytes} [Tue Aug 23 22:10:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 22:10:28.591323 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef9ac8-31ef-4e35-a6b4-a1cde37a43e7 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:28.666346 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:28.689116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef9ac8-31ef-4e35-a6b4-a1cde37a43e7 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:28.722750 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154b956-75c6-403b-9188-c1bc864573bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:28.723343 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154b956-75c6-403b-9188-c1bc864573bf None admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:28.723623 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154b956-75c6-403b-9188-c1bc864573bf None admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:28.723924 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154b956-75c6-403b-9188-c1bc864573bf None admin] PATH_INFO: `/v3/services` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:28.724545 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154b956-75c6-403b-9188-c1bc864573bf None admin] RBAC: Adding query filter params (name=placement) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:10:28.724847 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154b956-75c6-403b-9188-c1bc864573bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:28.726216 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154b956-75c6-403b-9188-c1bc864573bf None admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:28.731069 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 467/926] 10.222.0.58 () {56 vars in 1116 bytes} [Tue Aug 23 22:10:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:10:28.736839 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475107b-66b7-4930-860a-8f397872fcaf None admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:10:28.836184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475107b-66b7-4930-860a-8f397872fcaf None admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:10:28.869145 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe907056-c877-4378-8eda-2ed91a7a3cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:10:28.869728 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe907056-c877-4378-8eda-2ed91a7a3cd5 None admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:10:28.870003 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe907056-c877-4378-8eda-2ed91a7a3cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:10:28.870273 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe907056-c877-4378-8eda-2ed91a7a3cd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:10:28.870911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe907056-c877-4378-8eda-2ed91a7a3cd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:10:28.872293 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe907056-c877-4378-8eda-2ed91a7a3cd5 None admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:10:28.891783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 460/927] 10.222.0.58 () {60 vars in 1144 bytes} [Tue Aug 23 22:10:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:10:38.728281 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=30 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:10:38.887881 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:29.239003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc287246-03fd-4d29-a99c-7ee72c60266b None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:29.239518 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc287246-03fd-4d29-a99c-7ee72c60266b None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:29.239518 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc287246-03fd-4d29-a99c-7ee72c60266b None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:29.241144 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 468/928] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:29.247459 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74803e05-9ea1-491b-8beb-45432741334d None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:29.247941 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74803e05-9ea1-491b-8beb-45432741334d None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:29.248020 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74803e05-9ea1-491b-8beb-45432741334d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:29.272308 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-74803e05-9ea1-491b-8beb-45432741334d None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:29.273646 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-74803e05-9ea1-491b-8beb-45432741334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:29.383880 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 461/929] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:11:29.738635 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79533ad-1fdc-4c29-a10d-be9ad3da1085 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:29.738920 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79533ad-1fdc-4c29-a10d-be9ad3da1085 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:29.739506 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79533ad-1fdc-4c29-a10d-be9ad3da1085 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:29.740805 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 469/930] 10.222.0.58 () {54 vars in 965 bytes} [Tue Aug 23 22:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:29.748117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edcc01-2324-4865-bbef-036598dd9c2c None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:29.748603 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edcc01-2324-4865-bbef-036598dd9c2c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:29.749105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edcc01-2324-4865-bbef-036598dd9c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:29.815116 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-83edcc01-2324-4865-bbef-036598dd9c2c None None] MFA Rules not processed for user `b57524e5da8647a1a258f8c1e4258b62`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:29.816321 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-83edcc01-2324-4865-bbef-036598dd9c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:29.883932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 462/931] 10.222.0.58 () {58 vars in 1062 bytes} [Tue Aug 23 22:11:29 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:11:29.893534 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79533ad-1fdc-4c29-a10d-be9ad3da1085 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:29.904507 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79533ad-1fdc-4c29-a10d-be9ad3da1085 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:29.908109 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26932b-18cd-4c15-baae-f1264f2539e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:29.908705 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26932b-18cd-4c15-baae-f1264f2539e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:29.908987 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26932b-18cd-4c15-baae-f1264f2539e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:29.909253 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26932b-18cd-4c15-baae-f1264f2539e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:29.918703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26932b-18cd-4c15-baae-f1264f2539e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:29.920170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26932b-18cd-4c15-baae-f1264f2539e1 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:29.929933 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 470/932] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:11:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:11:32.470708 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643f1de-7e79-4f28-b8ac-36581be5c471 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:32.471268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643f1de-7e79-4f28-b8ac-36581be5c471 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:32.471268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643f1de-7e79-4f28-b8ac-36581be5c471 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:32.472776 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 463/933] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:32.477830 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb66ca-54a6-499a-81c8-481a5b7c6fd7 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:32.478265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb66ca-54a6-499a-81c8-481a5b7c6fd7 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:32.478383 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb66ca-54a6-499a-81c8-481a5b7c6fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:32.498669 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-41bb66ca-54a6-499a-81c8-481a5b7c6fd7 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:32.499991 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-41bb66ca-54a6-499a-81c8-481a5b7c6fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:32.508995 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 471/934] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:11:32.855175 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643f1de-7e79-4f28-b8ac-36581be5c471 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:32.867628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643f1de-7e79-4f28-b8ac-36581be5c471 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:32.871412 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0af25b-9c0d-4b30-8f5f-5325a3cd1418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:32.872222 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af25b-9c0d-4b30-8f5f-5325a3cd1418 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:32.872615 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af25b-9c0d-4b30-8f5f-5325a3cd1418 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:32.872997 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0af25b-9c0d-4b30-8f5f-5325a3cd1418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:32.883954 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0af25b-9c0d-4b30-8f5f-5325a3cd1418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:32.885569 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0af25b-9c0d-4b30-8f5f-5325a3cd1418 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:32.897859 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 464/935] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:11:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:11:35.444489 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7f0de-681e-43ba-88a3-149f8b0d1c7d None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:35.445036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7f0de-681e-43ba-88a3-149f8b0d1c7d None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:35.445036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7f0de-681e-43ba-88a3-149f8b0d1c7d None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:35.446533 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 472/936] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:35.451385 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af1ed7-b9c8-40b4-a32f-dc403c82fbc7 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:35.451783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af1ed7-b9c8-40b4-a32f-dc403c82fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:35.452163 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af1ed7-b9c8-40b4-a32f-dc403c82fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:35.490318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-d9af1ed7-b9c8-40b4-a32f-dc403c82fbc7 None None] MFA Rules not processed for user `5e19a867e25a4fc5bdd3ddce61a40937`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:35.491418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-d9af1ed7-b9c8-40b4-a32f-dc403c82fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:35.530677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:11:35.558833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 465/937] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:35 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:11:35.905152 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7f0de-681e-43ba-88a3-149f8b0d1c7d None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:35.916250 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7f0de-681e-43ba-88a3-149f8b0d1c7d None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:35.919721 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b17dba-677f-4b57-b684-6d5b9e7934fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:35.920350 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b17dba-677f-4b57-b684-6d5b9e7934fb service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:35.920630 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b17dba-677f-4b57-b684-6d5b9e7934fb service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:35.920903 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b17dba-677f-4b57-b684-6d5b9e7934fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:35.929809 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b17dba-677f-4b57-b684-6d5b9e7934fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:35.931233 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b17dba-677f-4b57-b684-6d5b9e7934fb service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:35.941803 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 473/938] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:11:35 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:11:38.710184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbe6c1-4254-49a7-83d4-297d106bd05a None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:38.710709 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbe6c1-4254-49a7-83d4-297d106bd05a None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:38.710709 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbe6c1-4254-49a7-83d4-297d106bd05a None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:38.712069 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 466/939] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:38.718397 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2377969-c5db-4ed1-b0c4-7075a29e1589 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:38.718805 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2377969-c5db-4ed1-b0c4-7075a29e1589 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:38.718943 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2377969-c5db-4ed1-b0c4-7075a29e1589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:38.737842 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-c2377969-c5db-4ed1-b0c4-7075a29e1589 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:38.739036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-c2377969-c5db-4ed1-b0c4-7075a29e1589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:38.810357 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 474/940] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:38 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:11:39.151191 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbe6c1-4254-49a7-83d4-297d106bd05a None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:39.162470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbe6c1-4254-49a7-83d4-297d106bd05a None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:39.165958 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4f2dc-4ffd-453f-be0f-7882833c6bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:39.166538 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4f2dc-4ffd-453f-be0f-7882833c6bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:39.166817 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4f2dc-4ffd-453f-be0f-7882833c6bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:39.167088 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4f2dc-4ffd-453f-be0f-7882833c6bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:39.177443 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4f2dc-4ffd-453f-be0f-7882833c6bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:39.178857 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4f2dc-4ffd-453f-be0f-7882833c6bc4 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:39.190038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 467/941] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:11:39 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:11:42.023578 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9775f8-51c4-44bd-9af1-36be5ad88c10 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.024162 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9775f8-51c4-44bd-9af1-36be5ad88c10 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.024162 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9775f8-51c4-44bd-9af1-36be5ad88c10 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.025503 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 475/942] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:42.030683 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e647335-54bf-4ae9-a6ae-a646b94a99df None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.031104 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e647335-54bf-4ae9-a6ae-a646b94a99df None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.031232 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e647335-54bf-4ae9-a6ae-a646b94a99df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.050591 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-8e647335-54bf-4ae9-a6ae-a646b94a99df None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:42.051766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-8e647335-54bf-4ae9-a6ae-a646b94a99df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:42.059371 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 468/943] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:11:42.397739 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9775f8-51c4-44bd-9af1-36be5ad88c10 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:42.408832 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9775f8-51c4-44bd-9af1-36be5ad88c10 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:42.412252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26504c-1340-4ae1-9aa0-f2a4e9641567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:42.412923 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26504c-1340-4ae1-9aa0-f2a4e9641567 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:42.413203 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26504c-1340-4ae1-9aa0-f2a4e9641567 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:42.413498 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26504c-1340-4ae1-9aa0-f2a4e9641567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:42.422190 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26504c-1340-4ae1-9aa0-f2a4e9641567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:42.424266 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26504c-1340-4ae1-9aa0-f2a4e9641567 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:42.433926 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 476/944] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:11:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:11:44.677756 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3f0d0-8e40-45df-bd5a-41e4d0a67a3e None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:44.678279 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3f0d0-8e40-45df-bd5a-41e4d0a67a3e None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:44.678279 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3f0d0-8e40-45df-bd5a-41e4d0a67a3e None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:44.679626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 469/945] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:44.684755 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d78de-c2f5-41f7-9682-3e58135fe66f None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:44.685166 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d78de-c2f5-41f7-9682-3e58135fe66f None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:44.685445 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d78de-c2f5-41f7-9682-3e58135fe66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:44.705838 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-d49d78de-c2f5-41f7-9682-3e58135fe66f None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:44.707034 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-d49d78de-c2f5-41f7-9682-3e58135fe66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:44.714721 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 477/946] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:11:45.054956 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3f0d0-8e40-45df-bd5a-41e4d0a67a3e None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:45.066356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3f0d0-8e40-45df-bd5a-41e4d0a67a3e None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:45.069969 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf19d0-dd5a-4d80-8199-03a07acaec13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:45.070557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf19d0-dd5a-4d80-8199-03a07acaec13 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:45.070836 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf19d0-dd5a-4d80-8199-03a07acaec13 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:45.071108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf19d0-dd5a-4d80-8199-03a07acaec13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:45.080105 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf19d0-dd5a-4d80-8199-03a07acaec13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:45.081528 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf19d0-dd5a-4d80-8199-03a07acaec13 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:45.090937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 470/947] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:11:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:11:47.336686 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ca0e5-611e-478c-9ac7-4826ca3ce55f None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.337265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ca0e5-611e-478c-9ac7-4826ca3ce55f None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.337265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ca0e5-611e-478c-9ac7-4826ca3ce55f None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.338578 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 478/948] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:47.344114 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c2287-b9e6-41b7-82ee-9ea2d352d48f None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.344892 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c2287-b9e6-41b7-82ee-9ea2d352d48f None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.345074 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c2287-b9e6-41b7-82ee-9ea2d352d48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.365510 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-a07c2287-b9e6-41b7-82ee-9ea2d352d48f None None] MFA Rules not processed for user `5e19a867e25a4fc5bdd3ddce61a40937`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:47.367024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-a07c2287-b9e6-41b7-82ee-9ea2d352d48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:47.375199 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 471/949] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:47 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:11:47.716082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ca0e5-611e-478c-9ac7-4826ca3ce55f None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:47.728010 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ca0e5-611e-478c-9ac7-4826ca3ce55f None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:47.731434 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b4c5-6f2a-420e-96e0-446bf1155ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:47.732054 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b4c5-6f2a-420e-96e0-446bf1155ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:47.732338 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b4c5-6f2a-420e-96e0-446bf1155ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:47.732613 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b4c5-6f2a-420e-96e0-446bf1155ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:47.742542 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b4c5-6f2a-420e-96e0-446bf1155ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:47.744025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b4c5-6f2a-420e-96e0-446bf1155ff5 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:47.753736 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 479/950] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:11:47 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:11:50.173838 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c85543-b7fc-4123-a2bc-fc03fa31e23d None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:50.174395 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c85543-b7fc-4123-a2bc-fc03fa31e23d None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:50.174395 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c85543-b7fc-4123-a2bc-fc03fa31e23d None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:50.175852 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 472/951] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:50.181559 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaf316-120f-41e2-b2d2-02d44a4f63ae None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:50.181987 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaf316-120f-41e2-b2d2-02d44a4f63ae None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:50.182100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaf316-120f-41e2-b2d2-02d44a4f63ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:50.202784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-5ebaf316-120f-41e2-b2d2-02d44a4f63ae None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:50.204012 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-5ebaf316-120f-41e2-b2d2-02d44a4f63ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:50.212616 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 480/952] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:11:50.561528 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c85543-b7fc-4123-a2bc-fc03fa31e23d None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:50.573491 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c85543-b7fc-4123-a2bc-fc03fa31e23d None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:50.577024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5666-7925-43b5-9728-bc98fa5e4414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:50.577622 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5666-7925-43b5-9728-bc98fa5e4414 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:50.577903 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5666-7925-43b5-9728-bc98fa5e4414 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:50.578174 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5666-7925-43b5-9728-bc98fa5e4414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:50.587717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5666-7925-43b5-9728-bc98fa5e4414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:50.589182 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5666-7925-43b5-9728-bc98fa5e4414 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:50.599705 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 473/953] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:11:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:11:52.872078 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61797f11-09c6-422b-98fe-a1363d7b3e2f None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:52.872618 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61797f11-09c6-422b-98fe-a1363d7b3e2f None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:52.872618 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61797f11-09c6-422b-98fe-a1363d7b3e2f None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:52.874147 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 481/954] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:52.880130 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8caa4-a6bd-422c-9f65-f856f62fca85 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:52.880562 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8caa4-a6bd-422c-9f65-f856f62fca85 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:52.880765 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8caa4-a6bd-422c-9f65-f856f62fca85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:52.901277 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-2df8caa4-a6bd-422c-9f65-f856f62fca85 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:52.902537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-2df8caa4-a6bd-422c-9f65-f856f62fca85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:52.912041 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 474/955] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:11:53.268265 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61797f11-09c6-422b-98fe-a1363d7b3e2f None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:53.279567 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61797f11-09c6-422b-98fe-a1363d7b3e2f None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:53.283205 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f78786a-a0a2-491f-9c6f-f908181820ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:53.283800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78786a-a0a2-491f-9c6f-f908181820ca service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:53.284105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78786a-a0a2-491f-9c6f-f908181820ca service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:53.284371 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f78786a-a0a2-491f-9c6f-f908181820ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:53.294674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78786a-a0a2-491f-9c6f-f908181820ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:53.296181 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f78786a-a0a2-491f-9c6f-f908181820ca service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:53.306802 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 482/956] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:11:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:11:55.840186 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bea34e-fbb4-428a-83f5-311a287290aa None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:55.840754 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bea34e-fbb4-428a-83f5-311a287290aa None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:55.840754 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bea34e-fbb4-428a-83f5-311a287290aa None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:55.842060 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 475/957] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:11:55.847877 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab98215-2ab9-4af6-9d97-651f9f51a187 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:55.848287 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab98215-2ab9-4af6-9d97-651f9f51a187 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:55.848414 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab98215-2ab9-4af6-9d97-651f9f51a187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:55.867733 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-fab98215-2ab9-4af6-9d97-651f9f51a187 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:11:55.868957 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-fab98215-2ab9-4af6-9d97-651f9f51a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:11:55.877601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 483/958] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:11:55 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:11:56.218754 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bea34e-fbb4-428a-83f5-311a287290aa None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:11:56.229717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bea34e-fbb4-428a-83f5-311a287290aa None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:11:56.233190 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1fdc9-455b-4573-9883-5246ecc5d969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:11:56.233778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1fdc9-455b-4573-9883-5246ecc5d969 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:11:56.234057 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1fdc9-455b-4573-9883-5246ecc5d969 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:11:56.234330 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1fdc9-455b-4573-9883-5246ecc5d969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:11:56.243555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1fdc9-455b-4573-9883-5246ecc5d969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:11:56.245009 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1fdc9-455b-4573-9883-5246ecc5d969 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:11:56.255053 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 476/959] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:11:56 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:00.366845 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874667de-a79b-4b92-a771-52f2bbd4f3e4 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.367342 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874667de-a79b-4b92-a771-52f2bbd4f3e4 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.367342 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874667de-a79b-4b92-a771-52f2bbd4f3e4 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.368676 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 484/960] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:00.373798 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a46de-ef3d-4f27-a383-f5d0d75613a3 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.374196 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a46de-ef3d-4f27-a383-f5d0d75613a3 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.374336 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a46de-ef3d-4f27-a383-f5d0d75613a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.393878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-c28a46de-ef3d-4f27-a383-f5d0d75613a3 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:00.395136 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-c28a46de-ef3d-4f27-a383-f5d0d75613a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:00.402897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 477/961] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:00.750186 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874667de-a79b-4b92-a771-52f2bbd4f3e4 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:00.756306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=74 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:00.770182 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874667de-a79b-4b92-a771-52f2bbd4f3e4 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:00.773664 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c80b68-901e-4dce-83ff-913f93e1b759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:00.774262 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80b68-901e-4dce-83ff-913f93e1b759 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:00.774540 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80b68-901e-4dce-83ff-913f93e1b759 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:00.774812 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c80b68-901e-4dce-83ff-913f93e1b759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:00.784405 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c80b68-901e-4dce-83ff-913f93e1b759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:00.785843 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c80b68-901e-4dce-83ff-913f93e1b759 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:00.795448 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 485/962] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:03.638983 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c659de-5881-406a-80e3-78e5e1aa5fdd None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:03.639561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c659de-5881-406a-80e3-78e5e1aa5fdd None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:03.639561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c659de-5881-406a-80e3-78e5e1aa5fdd None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:03.641012 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 478/963] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:03.646660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259696b1-0748-43b2-a0d1-7ce034bf2209 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:03.647080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259696b1-0748-43b2-a0d1-7ce034bf2209 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:03.647339 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259696b1-0748-43b2-a0d1-7ce034bf2209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:03.666741 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-259696b1-0748-43b2-a0d1-7ce034bf2209 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:03.667957 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-259696b1-0748-43b2-a0d1-7ce034bf2209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:03.676101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 486/964] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:03 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:04.025768 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c659de-5881-406a-80e3-78e5e1aa5fdd None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:04.037290 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c659de-5881-406a-80e3-78e5e1aa5fdd None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:04.040826 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f251f-1210-4f0d-abbb-0d605620cd91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:04.041416 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f251f-1210-4f0d-abbb-0d605620cd91 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:04.041692 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f251f-1210-4f0d-abbb-0d605620cd91 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:04.041961 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f251f-1210-4f0d-abbb-0d605620cd91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:04.051243 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f251f-1210-4f0d-abbb-0d605620cd91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:04.052700 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f251f-1210-4f0d-abbb-0d605620cd91 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:04.062028 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 479/965] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:04 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:08.220280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632f0a-c466-425f-9c57-075f1d4b7872 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.220732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632f0a-c466-425f-9c57-075f1d4b7872 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.220985 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68632f0a-c466-425f-9c57-075f1d4b7872 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.222671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 487/966] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:08.227868 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd41e3-271d-4fc1-a285-3e57e3340c68 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.228326 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd41e3-271d-4fc1-a285-3e57e3340c68 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.228422 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd41e3-271d-4fc1-a285-3e57e3340c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.236481 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=54 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:08.250187 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-98cd41e3-271d-4fc1-a285-3e57e3340c68 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:08.252057 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-98cd41e3-271d-4fc1-a285-3e57e3340c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:08.259888 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 480/967] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:08.600047 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68632f0a-c466-425f-9c57-075f1d4b7872 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:08.611507 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68632f0a-c466-425f-9c57-075f1d4b7872 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:08.614927 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cb601-6e27-4f45-a786-6564b74f0122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:08.615508 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cb601-6e27-4f45-a786-6564b74f0122 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:08.615927 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cb601-6e27-4f45-a786-6564b74f0122 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:08.616194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cb601-6e27-4f45-a786-6564b74f0122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:08.624876 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cb601-6e27-4f45-a786-6564b74f0122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:08.626989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cb601-6e27-4f45-a786-6564b74f0122 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:08.636180 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 488/968] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:14.207598 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee70b50-b99c-4c68-b1f4-c343b99bbeb7 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.208492 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee70b50-b99c-4c68-b1f4-c343b99bbeb7 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.208948 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee70b50-b99c-4c68-b1f4-c343b99bbeb7 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.210694 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 481/969] 10.222.0.58 () {54 vars in 921 bytes} [Tue Aug 23 22:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:14.215748 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89377f-7a78-46b8-9c8c-a0b924cd29cc None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:14.216578 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89377f-7a78-46b8-9c8c-a0b924cd29cc None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:14.217026 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89377f-7a78-46b8-9c8c-a0b924cd29cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:14.312857 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-5a89377f-7a78-46b8-9c8c-a0b924cd29cc None None] MFA Rules not processed for user `7a55d53b8c1a4dffa00b9114d1df498a`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:14.314826 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-5a89377f-7a78-46b8-9c8c-a0b924cd29cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:14.393194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 489/970] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Aug 23 22:12:14 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:18.245596 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=2 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:19.049309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8a352-4ff5-4919-8994-b8044c83c025 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:19.049488 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8a352-4ff5-4919-8994-b8044c83c025 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:19.049744 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8a352-4ff5-4919-8994-b8044c83c025 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:19.051455 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 482/971] 10.222.0.58 () {54 vars in 921 bytes} [Tue Aug 23 22:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:19.057687 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471993ee-4cf6-44ec-856d-7030e17c77f8 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:19.058848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471993ee-4cf6-44ec-856d-7030e17c77f8 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:19.059363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471993ee-4cf6-44ec-856d-7030e17c77f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:19.086268 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-471993ee-4cf6-44ec-856d-7030e17c77f8 None None] MFA Rules not processed for user `7a55d53b8c1a4dffa00b9114d1df498a`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:19.087921 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-471993ee-4cf6-44ec-856d-7030e17c77f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:19.098457 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 490/972] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Aug 23 22:12:19 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:20.599201 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aa7ff-f5ac-4960-be27-183d80c89dbc None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:20.599732 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aa7ff-f5ac-4960-be27-183d80c89dbc None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:20.599732 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8aa7ff-f5ac-4960-be27-183d80c89dbc None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:20.601089 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 483/973] 10.222.0.58 () {54 vars in 921 bytes} [Tue Aug 23 22:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:20.606163 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895dae2-fd23-4258-b520-0eb261af0bf3 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:20.606543 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895dae2-fd23-4258-b520-0eb261af0bf3 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:20.606843 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895dae2-fd23-4258-b520-0eb261af0bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:20.627102 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-c895dae2-fd23-4258-b520-0eb261af0bf3 None None] MFA Rules not processed for user `7a55d53b8c1a4dffa00b9114d1df498a`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:20.628442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-c895dae2-fd23-4258-b520-0eb261af0bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:20.637241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 491/974] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Aug 23 22:12:20 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:12:24.551933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e05cad-fb58-4571-838b-174fa59f96fd None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.552441 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e05cad-fb58-4571-838b-174fa59f96fd None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.552441 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e05cad-fb58-4571-838b-174fa59f96fd None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.553939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 484/975] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:24.559154 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2b40d-209a-4582-aed7-13e5421aa02c None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.559567 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2b40d-209a-4582-aed7-13e5421aa02c None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.559717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2b40d-209a-4582-aed7-13e5421aa02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.580517 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-25c2b40d-209a-4582-aed7-13e5421aa02c None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:24.581714 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-25c2b40d-209a-4582-aed7-13e5421aa02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:24.590070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 492/976] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:24.992234 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d406d6c-d89e-45af-86b4-3673e6d00ba3 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:24.992848 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d406d6c-d89e-45af-86b4-3673e6d00ba3 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:24.993281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d406d6c-d89e-45af-86b4-3673e6d00ba3 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:24.996381 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 485/977] 10.222.0.58 () {54 vars in 962 bytes} [Tue Aug 23 22:12:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:25.006241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a492e-4502-476f-ae8d-5bbd8078ed85 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.006764 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a492e-4502-476f-ae8d-5bbd8078ed85 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.007613 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a492e-4502-476f-ae8d-5bbd8078ed85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.061438 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-284a492e-4502-476f-ae8d-5bbd8078ed85 None None] MFA Rules not processed for user `d43a6040fd95466fa17acdb1f30476ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:25.063489 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-284a492e-4502-476f-ae8d-5bbd8078ed85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:25.155258 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=100 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:25.163142 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 493/978] 10.222.0.58 () {58 vars in 1059 bytes} [Tue Aug 23 22:12:25 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:12:25.171512 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d406d6c-d89e-45af-86b4-3673e6d00ba3 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:25.186731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d406d6c-d89e-45af-86b4-3673e6d00ba3 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:25.194653 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dabd3e-6cb6-4612-820d-e18758d10c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:25.195437 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dabd3e-6cb6-4612-820d-e18758d10c1c service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:25.196104 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dabd3e-6cb6-4612-820d-e18758d10c1c service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:25.196555 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dabd3e-6cb6-4612-820d-e18758d10c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:25.207740 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dabd3e-6cb6-4612-820d-e18758d10c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:25.210322 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dabd3e-6cb6-4612-820d-e18758d10c1c service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:25.229699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 486/979] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:27.741957 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917bf06-0117-4463-a803-a1a30712c68e None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.742502 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917bf06-0117-4463-a803-a1a30712c68e None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.742711 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917bf06-0117-4463-a803-a1a30712c68e None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.744248 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 494/980] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:27.749552 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252342f-02d3-4d8d-9eca-30bfe34d165e None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:27.749977 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252342f-02d3-4d8d-9eca-30bfe34d165e None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:27.750101 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252342f-02d3-4d8d-9eca-30bfe34d165e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:27.770778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-e252342f-02d3-4d8d-9eca-30bfe34d165e None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:27.772111 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-e252342f-02d3-4d8d-9eca-30bfe34d165e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:27.779983 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 487/981] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:28.132810 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917bf06-0117-4463-a803-a1a30712c68e None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:28.146327 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917bf06-0117-4463-a803-a1a30712c68e None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:28.151175 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01f8a7-33f3-48af-bfd2-660fe2215ae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:28.151772 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01f8a7-33f3-48af-bfd2-660fe2215ae6 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:28.152088 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01f8a7-33f3-48af-bfd2-660fe2215ae6 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:28.152363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01f8a7-33f3-48af-bfd2-660fe2215ae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:28.161792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01f8a7-33f3-48af-bfd2-660fe2215ae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:28.163411 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01f8a7-33f3-48af-bfd2-660fe2215ae6 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:28.173736 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 495/982] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:30.767520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51475c-2344-47d4-b747-7e0c30fd873c None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:30.768076 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51475c-2344-47d4-b747-7e0c30fd873c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:30.768180 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51475c-2344-47d4-b747-7e0c30fd873c None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:30.769437 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 488/983] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:30.774890 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0befa-fed6-4faf-aee6-14d72d967f6e None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:30.775297 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0befa-fed6-4faf-aee6-14d72d967f6e None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:30.775442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0befa-fed6-4faf-aee6-14d72d967f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:30.796410 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-ede0befa-fed6-4faf-aee6-14d72d967f6e None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:30.798398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-ede0befa-fed6-4faf-aee6-14d72d967f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:30.806240 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 496/984] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:31.165138 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438b3a1-7bdf-4753-8643-89b9233ee590 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:31.165427 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438b3a1-7bdf-4753-8643-89b9233ee590 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:31.165702 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438b3a1-7bdf-4753-8643-89b9233ee590 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:31.167174 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 489/985] 10.222.0.58 () {54 vars in 962 bytes} [Tue Aug 23 22:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:31.174394 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc459a-115d-411c-94c8-f5d1f66bde6e None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:31.174678 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc459a-115d-411c-94c8-f5d1f66bde6e None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:31.174954 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc459a-115d-411c-94c8-f5d1f66bde6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:31.195381 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-80dc459a-115d-411c-94c8-f5d1f66bde6e None None] MFA Rules not processed for user `d43a6040fd95466fa17acdb1f30476ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:31.196651 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-80dc459a-115d-411c-94c8-f5d1f66bde6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:31.205734 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 497/986] 10.222.0.58 () {58 vars in 1059 bytes} [Tue Aug 23 22:12:31 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:31.213650 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438b3a1-7bdf-4753-8643-89b9233ee590 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:31.242561 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438b3a1-7bdf-4753-8643-89b9233ee590 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:31.247559 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20d2df-8fd0-4e5a-a222-6a60cf267e6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:31.248266 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20d2df-8fd0-4e5a-a222-6a60cf267e6d service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:31.248542 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20d2df-8fd0-4e5a-a222-6a60cf267e6d service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:31.249081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20d2df-8fd0-4e5a-a222-6a60cf267e6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:31.261491 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20d2df-8fd0-4e5a-a222-6a60cf267e6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:31.263122 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20d2df-8fd0-4e5a-a222-6a60cf267e6d service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:31.274505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 490/987] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:33.647015 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac9e3c-3d25-40d1-8e3b-9bdec4111bb2 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.647926 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac9e3c-3d25-40d1-8e3b-9bdec4111bb2 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.648373 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac9e3c-3d25-40d1-8e3b-9bdec4111bb2 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.653955 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 498/988] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:33.655330 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3acde-ec58-4fd8-a649-8a53c5c5e00b None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:33.655759 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3acde-ec58-4fd8-a649-8a53c5c5e00b None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:33.655919 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3acde-ec58-4fd8-a649-8a53c5c5e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:33.676019 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-2ba3acde-ec58-4fd8-a649-8a53c5c5e00b None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:33.677498 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-2ba3acde-ec58-4fd8-a649-8a53c5c5e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:33.686055 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 491/989] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:34.062980 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac9e3c-3d25-40d1-8e3b-9bdec4111bb2 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:34.077585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac9e3c-3d25-40d1-8e3b-9bdec4111bb2 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:34.083795 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9c684-98a9-4b40-aaec-060382275612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:34.084604 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9c684-98a9-4b40-aaec-060382275612 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:34.085166 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9c684-98a9-4b40-aaec-060382275612 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:34.085604 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9c684-98a9-4b40-aaec-060382275612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:34.095363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9c684-98a9-4b40-aaec-060382275612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:34.097261 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9c684-98a9-4b40-aaec-060382275612 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:34.107324 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 499/990] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:35.127869 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188183f-c89b-4107-a3b4-53ee62f61727 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:35.128362 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188183f-c89b-4107-a3b4-53ee62f61727 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:35.128446 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188183f-c89b-4107-a3b4-53ee62f61727 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:35.129738 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 492/991] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:35.138590 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031c4f0-3ba4-402f-9e70-0d97e5a6d115 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:35.138590 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031c4f0-3ba4-402f-9e70-0d97e5a6d115 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:35.138590 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031c4f0-3ba4-402f-9e70-0d97e5a6d115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:35.170101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-c031c4f0-3ba4-402f-9e70-0d97e5a6d115 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:35.176656 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-c031c4f0-3ba4-402f-9e70-0d97e5a6d115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:35.188385 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 500/992] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:35.813976 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425496f2-5ee5-488c-af25-4cc44b5bc862 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:35.813976 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425496f2-5ee5-488c-af25-4cc44b5bc862 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:35.813976 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425496f2-5ee5-488c-af25-4cc44b5bc862 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:35.815373 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 493/993] 10.222.0.58 () {54 vars in 964 bytes} [Tue Aug 23 22:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:35.819942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cf6cf-1cbf-40cf-b598-ca1a73e3946f None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:35.820461 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cf6cf-1cbf-40cf-b598-ca1a73e3946f None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:35.820864 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cf6cf-1cbf-40cf-b598-ca1a73e3946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:35.861975 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-c00cf6cf-1cbf-40cf-b598-ca1a73e3946f None None] MFA Rules not processed for user `60819c30ec7c42d1a1891e7ce07f8473`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:35.863342 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-c00cf6cf-1cbf-40cf-b598-ca1a73e3946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:35.929204 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 501/994] 10.222.0.58 () {58 vars in 1061 bytes} [Tue Aug 23 22:12:35 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:35.936726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425496f2-5ee5-488c-af25-4cc44b5bc862 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:35.948771 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425496f2-5ee5-488c-af25-4cc44b5bc862 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:35.952418 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb299b-54a8-4110-9a33-fd09e12a07a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60819c30ec7c42d1a1891e7ce07f8473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:35.953251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb299b-54a8-4110-9a33-fd09e12a07a7 service cinder] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:35.954314 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb299b-54a8-4110-9a33-fd09e12a07a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:35.954710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb299b-54a8-4110-9a33-fd09e12a07a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:35.964376 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb299b-54a8-4110-9a33-fd09e12a07a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:35.965939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb299b-54a8-4110-9a33-fd09e12a07a7 service cinder] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:35.976650 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 494/995] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:36.448234 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e54f85-af94-4ff7-9394-aaf987af12bc None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.448804 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e54f85-af94-4ff7-9394-aaf987af12bc None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.448993 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e54f85-af94-4ff7-9394-aaf987af12bc None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.450425 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 502/996] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:36.456446 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf6c3d-2369-47f7-86c7-c652d899b75c None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.456941 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf6c3d-2369-47f7-86c7-c652d899b75c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.457034 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf6c3d-2369-47f7-86c7-c652d899b75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.476854 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-82cf6c3d-2369-47f7-86c7-c652d899b75c None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:36.478054 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-82cf6c3d-2369-47f7-86c7-c652d899b75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:36.486773 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 495/997] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:36.841186 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e54f85-af94-4ff7-9394-aaf987af12bc None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:36.867069 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e54f85-af94-4ff7-9394-aaf987af12bc None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:36.877801 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe58a-4bed-4a50-afee-bc0d6700f808 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:36.879057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe58a-4bed-4a50-afee-bc0d6700f808 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:36.879711 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe58a-4bed-4a50-afee-bc0d6700f808 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:36.880688 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe58a-4bed-4a50-afee-bc0d6700f808 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:36.892586 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfe58a-4bed-4a50-afee-bc0d6700f808 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:36.895269 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfe58a-4bed-4a50-afee-bc0d6700f808 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:36.906491 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 503/998] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:39.256624 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa7c7d-3df3-45dd-ae56-2aab7cf9367c None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.257082 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa7c7d-3df3-45dd-ae56-2aab7cf9367c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.257175 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa7c7d-3df3-45dd-ae56-2aab7cf9367c None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.258486 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 496/999] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:39.263757 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c561f-7a3c-41a3-8630-f50b97cc5ac3 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.264196 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c561f-7a3c-41a3-8630-f50b97cc5ac3 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.264340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c561f-7a3c-41a3-8630-f50b97cc5ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.283246 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-6b6c561f-7a3c-41a3-8630-f50b97cc5ac3 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:39.284630 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-6b6c561f-7a3c-41a3-8630-f50b97cc5ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:39.292395 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 504/1000] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:39.646901 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa7c7d-3df3-45dd-ae56-2aab7cf9367c None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:39.661511 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa7c7d-3df3-45dd-ae56-2aab7cf9367c None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:39.666258 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1b621-049d-4e00-8cf5-dc303d06470d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:39.666847 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1b621-049d-4e00-8cf5-dc303d06470d service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:39.667124 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1b621-049d-4e00-8cf5-dc303d06470d service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:39.667388 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1b621-049d-4e00-8cf5-dc303d06470d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:39.676009 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1b621-049d-4e00-8cf5-dc303d06470d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:39.677575 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1b621-049d-4e00-8cf5-dc303d06470d service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:39.686979 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 497/1001] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:41.970795 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52585f-54f9-4ff6-bd19-8e2cc127bef8 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.971351 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52585f-54f9-4ff6-bd19-8e2cc127bef8 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.971351 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52585f-54f9-4ff6-bd19-8e2cc127bef8 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:41.972682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 505/1002] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:41.978012 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36118fc-659c-40d9-80f6-a2424f079c66 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:41.978437 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36118fc-659c-40d9-80f6-a2424f079c66 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:41.978552 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36118fc-659c-40d9-80f6-a2424f079c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:42.000493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-d36118fc-659c-40d9-80f6-a2424f079c66 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:42.001982 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-d36118fc-659c-40d9-80f6-a2424f079c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:42.009920 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 498/1003] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:42.358340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52585f-54f9-4ff6-bd19-8e2cc127bef8 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:42.372941 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52585f-54f9-4ff6-bd19-8e2cc127bef8 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:42.379063 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf6e84-c2f5-4254-8efb-7bb7fa4d955d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:42.379672 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf6e84-c2f5-4254-8efb-7bb7fa4d955d service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:42.380008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf6e84-c2f5-4254-8efb-7bb7fa4d955d service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:42.380290 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf6e84-c2f5-4254-8efb-7bb7fa4d955d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:42.389850 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf6e84-c2f5-4254-8efb-7bb7fa4d955d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:42.391499 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf6e84-c2f5-4254-8efb-7bb7fa4d955d service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:42.401637 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 506/1004] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:44.677915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530f1c3-b134-4594-b2b0-e0c1a6088802 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:44.678608 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530f1c3-b134-4594-b2b0-e0c1a6088802 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:44.678608 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530f1c3-b134-4594-b2b0-e0c1a6088802 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.680088 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 499/1005] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:44.685493 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79b605-c703-4297-becb-9bdf73041de9 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:44.685953 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79b605-c703-4297-becb-9bdf73041de9 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:44.686119 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79b605-c703-4297-becb-9bdf73041de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:44.707064 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-ce79b605-c703-4297-becb-9bdf73041de9 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:44.708317 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-ce79b605-c703-4297-becb-9bdf73041de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:44.717011 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 507/1006] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:45.079072 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530f1c3-b134-4594-b2b0-e0c1a6088802 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:45.092946 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530f1c3-b134-4594-b2b0-e0c1a6088802 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:45.098902 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca0e4c-4ab0-4dd5-852d-69d51e4cb02a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:45.099501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca0e4c-4ab0-4dd5-852d-69d51e4cb02a service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:45.099786 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca0e4c-4ab0-4dd5-852d-69d51e4cb02a service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:45.100099 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca0e4c-4ab0-4dd5-852d-69d51e4cb02a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:45.108679 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca0e4c-4ab0-4dd5-852d-69d51e4cb02a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:45.110404 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca0e4c-4ab0-4dd5-852d-69d51e4cb02a service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:45.120338 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 500/1007] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:12:47.449141 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dde78a-4082-4bef-a11e-9127b6b8ae47 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.451202 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dde78a-4082-4bef-a11e-9127b6b8ae47 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.451202 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dde78a-4082-4bef-a11e-9127b6b8ae47 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.451202 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 508/1008] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:47.457004 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b18743-0e9a-445b-9fe4-abffa16dd79b None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.457502 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b18743-0e9a-445b-9fe4-abffa16dd79b None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.457809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b18743-0e9a-445b-9fe4-abffa16dd79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.481629 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-82b18743-0e9a-445b-9fe4-abffa16dd79b None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:47.482913 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-82b18743-0e9a-445b-9fe4-abffa16dd79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:47.491982 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 501/1009] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:47.854961 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dde78a-4082-4bef-a11e-9127b6b8ae47 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:47.870052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dde78a-4082-4bef-a11e-9127b6b8ae47 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:47.875365 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43e770-8de6-424a-8224-cee381cd3742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:47.876003 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43e770-8de6-424a-8224-cee381cd3742 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:47.876306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43e770-8de6-424a-8224-cee381cd3742 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:47.876558 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43e770-8de6-424a-8224-cee381cd3742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:47.885054 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43e770-8de6-424a-8224-cee381cd3742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:47.886669 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43e770-8de6-424a-8224-cee381cd3742 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:47.897762 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 509/1010] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:50.819986 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a5b44-e9e2-48df-9893-1940631d88be None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.820578 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a5b44-e9e2-48df-9893-1940631d88be None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.820578 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a5b44-e9e2-48df-9893-1940631d88be None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.821857 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 502/1011] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:50.827346 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c052e-22df-401e-bde1-320d78a01805 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:50.828006 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c052e-22df-401e-bde1-320d78a01805 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:50.828139 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c052e-22df-401e-bde1-320d78a01805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:50.850108 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-854c052e-22df-401e-bde1-320d78a01805 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:50.851306 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-854c052e-22df-401e-bde1-320d78a01805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:50.859099 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 510/1012] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:51.219258 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a5b44-e9e2-48df-9893-1940631d88be None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:51.227679 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=46 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:51.234788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a5b44-e9e2-48df-9893-1940631d88be None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:51.239938 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7f2fc-30c9-496e-a6c9-b1b36894a8c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:51.240538 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7f2fc-30c9-496e-a6c9-b1b36894a8c3 service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:51.240820 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7f2fc-30c9-496e-a6c9-b1b36894a8c3 service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:51.241092 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7f2fc-30c9-496e-a6c9-b1b36894a8c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:51.249779 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7f2fc-30c9-496e-a6c9-b1b36894a8c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:51.251376 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7f2fc-30c9-496e-a6c9-b1b36894a8c3 service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:51.261161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 503/1013] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:52.352587 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fc2bc-14d0-4f8a-8430-c1bb86436a98 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.353184 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fc2bc-14d0-4f8a-8430-c1bb86436a98 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.353291 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fc2bc-14d0-4f8a-8430-c1bb86436a98 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.354614 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 511/1014] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:52.359944 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38d796-1a4f-4983-9e88-6bc219bdb12a None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.360455 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38d796-1a4f-4983-9e88-6bc219bdb12a None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.360566 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38d796-1a4f-4983-9e88-6bc219bdb12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.380511 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-2f38d796-1a4f-4983-9e88-6bc219bdb12a None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:52.381717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-2f38d796-1a4f-4983-9e88-6bc219bdb12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:52.389940 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 504/1015] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:52.750570 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96095f6-5128-41b1-ac32-26339d5d72ce None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.750945 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96095f6-5128-41b1-ac32-26339d5d72ce None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.751284 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96095f6-5128-41b1-ac32-26339d5d72ce None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.753732 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 512/1016] 10.222.0.58 () {54 vars in 967 bytes} [Tue Aug 23 22:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:52.758918 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d57a3c-fb42-4ce3-8e58-c8783abe9cae None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.759206 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d57a3c-fb42-4ce3-8e58-c8783abe9cae None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.759479 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d57a3c-fb42-4ce3-8e58-c8783abe9cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.797027 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-42d57a3c-fb42-4ce3-8e58-c8783abe9cae None None] MFA Rules not processed for user `18eb03a1a720431a9c78883a0aab8741`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:52.805010 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-42d57a3c-fb42-4ce3-8e58-c8783abe9cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:52.877511 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 505/1017] 10.222.0.58 () {58 vars in 1064 bytes} [Tue Aug 23 22:12:52 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:52.885227 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96095f6-5128-41b1-ac32-26339d5d72ce None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:52.896897 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96095f6-5128-41b1-ac32-26339d5d72ce None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:52.900458 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368821f2-6413-4b54-b3e9-89f8289a650d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18eb03a1a720431a9c78883a0aab8741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:52.901047 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368821f2-6413-4b54-b3e9-89f8289a650d service glance] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:52.901354 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368821f2-6413-4b54-b3e9-89f8289a650d service glance] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:52.901629 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368821f2-6413-4b54-b3e9-89f8289a650d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:52.910764 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368821f2-6413-4b54-b3e9-89f8289a650d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:52.912248 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368821f2-6413-4b54-b3e9-89f8289a650d service glance] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:52.921796 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 513/1018] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:53.498410 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e607b8b-4f42-4230-b59e-61f9704c5bcd None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.498994 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e607b8b-4f42-4230-b59e-61f9704c5bcd None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.498994 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e607b8b-4f42-4230-b59e-61f9704c5bcd None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.500320 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 506/1019] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:53.506002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cdcbe-63a0-4f5e-ad64-06d78dea9321 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.506601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cdcbe-63a0-4f5e-ad64-06d78dea9321 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.506601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cdcbe-63a0-4f5e-ad64-06d78dea9321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.527479 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-559cdcbe-63a0-4f5e-ad64-06d78dea9321 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:53.528737 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-559cdcbe-63a0-4f5e-ad64-06d78dea9321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:53.537892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 514/1020] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:53.896497 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e607b8b-4f42-4230-b59e-61f9704c5bcd None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:53.912835 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e607b8b-4f42-4230-b59e-61f9704c5bcd None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:53.919632 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9c2a3-c39f-4641-83df-98e942f8fac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:53.920264 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9c2a3-c39f-4641-83df-98e942f8fac4 service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:53.920546 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9c2a3-c39f-4641-83df-98e942f8fac4 service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:53.920821 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9c2a3-c39f-4641-83df-98e942f8fac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:53.930278 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9c2a3-c39f-4641-83df-98e942f8fac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:53.931923 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9c2a3-c39f-4641-83df-98e942f8fac4 service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:53.943222 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 507/1021] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:12:56.227006 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c79b4-5edc-4d09-b359-c47402f546fd None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.227688 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c79b4-5edc-4d09-b359-c47402f546fd None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.227688 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c79b4-5edc-4d09-b359-c47402f546fd None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.228922 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 515/1022] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:12:56.234467 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d03263-307b-4ddf-ba47-4668c842ded0 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.234956 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d03263-307b-4ddf-ba47-4668c842ded0 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.235144 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d03263-307b-4ddf-ba47-4668c842ded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.257680 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-27d03263-307b-4ddf-ba47-4668c842ded0 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:12:56.258881 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-27d03263-307b-4ddf-ba47-4668c842ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:12:56.266878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 508/1023] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:12:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:12:56.624214 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c79b4-5edc-4d09-b359-c47402f546fd None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:12:56.632459 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=92 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:12:56.639818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c79b4-5edc-4d09-b359-c47402f546fd None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:12:56.650271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba515e-e949-4d86-beb7-85c5f7ab3dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:12:56.650892 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba515e-e949-4d86-beb7-85c5f7ab3dd3 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:12:56.651180 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba515e-e949-4d86-beb7-85c5f7ab3dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:12:56.651457 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba515e-e949-4d86-beb7-85c5f7ab3dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:12:56.661167 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba515e-e949-4d86-beb7-85c5f7ab3dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:12:56.662906 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba515e-e949-4d86-beb7-85c5f7ab3dd3 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:12:56.673519 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 516/1024] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:12:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:06.250994 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=50 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:06.668947 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=5 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:08.225801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735774-fd01-4e36-8d76-09974f1cbfd1 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:08.226480 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735774-fd01-4e36-8d76-09974f1cbfd1 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:08.226480 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735774-fd01-4e36-8d76-09974f1cbfd1 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:08.227653 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 509/1025] 10.222.0.58 () {54 vars in 918 bytes} [Tue Aug 23 22:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:08.232694 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bf39f-808b-4a0f-ada7-4a7ac651b537 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:08.233170 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bf39f-808b-4a0f-ada7-4a7ac651b537 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:08.233273 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bf39f-808b-4a0f-ada7-4a7ac651b537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:08.252294 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-027bf39f-808b-4a0f-ada7-4a7ac651b537 None None] MFA Rules not processed for user `7a55d53b8c1a4dffa00b9114d1df498a`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:08.254048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-027bf39f-808b-4a0f-ada7-4a7ac651b537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:08.262443 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 517/1026] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Aug 23 22:13:08 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:08.278696 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1d4f2-ff79-4068-98ff-a72e2de756ca None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:08.278977 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1d4f2-ff79-4068-98ff-a72e2de756ca None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:08.279274 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1d4f2-ff79-4068-98ff-a72e2de756ca None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:08.281382 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 510/1027] 10.222.0.58 () {54 vars in 918 bytes} [Tue Aug 23 22:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:08.286436 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22b3c5-11d1-4648-b469-6943484dcdc9 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:08.286723 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22b3c5-11d1-4648-b469-6943484dcdc9 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:08.286996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22b3c5-11d1-4648-b469-6943484dcdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:08.306355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-ad22b3c5-11d1-4648-b469-6943484dcdc9 None None] MFA Rules not processed for user `d43a6040fd95466fa17acdb1f30476ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:08.307537 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-ad22b3c5-11d1-4648-b469-6943484dcdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:08.316546 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 518/1028] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Aug 23 22:13:08 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:10.963767 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8f0a1-3c47-4c6c-8e86-ee23a08e41ea None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.964352 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8f0a1-3c47-4c6c-8e86-ee23a08e41ea None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.964352 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8f0a1-3c47-4c6c-8e86-ee23a08e41ea None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.965666 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 511/1029] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:10.971551 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e64d3a-44f6-4331-bd77-9f72f3be4090 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:10.972178 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e64d3a-44f6-4331-bd77-9f72f3be4090 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:10.972178 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e64d3a-44f6-4331-bd77-9f72f3be4090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:10.992522 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-a4e64d3a-44f6-4331-bd77-9f72f3be4090 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:10.993990 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-a4e64d3a-44f6-4331-bd77-9f72f3be4090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:11.002602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 519/1030] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:13:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:11.353505 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8f0a1-3c47-4c6c-8e86-ee23a08e41ea None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:11.369536 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8f0a1-3c47-4c6c-8e86-ee23a08e41ea None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:11.374740 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ceb58-f8bc-46af-9adb-1dc24ee01e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:11.375330 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ceb58-f8bc-46af-9adb-1dc24ee01e33 service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:11.375605 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ceb58-f8bc-46af-9adb-1dc24ee01e33 service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:11.375900 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ceb58-f8bc-46af-9adb-1dc24ee01e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:11.385068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ceb58-f8bc-46af-9adb-1dc24ee01e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:11.386643 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ceb58-f8bc-46af-9adb-1dc24ee01e33 service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:11.396145 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 512/1031] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:12.355436 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6284fdb-2561-4d70-96db-d3f276a2de9f None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.355984 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6284fdb-2561-4d70-96db-d3f276a2de9f None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.355984 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6284fdb-2561-4d70-96db-d3f276a2de9f None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.357347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 520/1032] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:12.362298 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc449dcc-dd73-4ce4-83ad-05cd92f076a9 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.362750 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc449dcc-dd73-4ce4-83ad-05cd92f076a9 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.362855 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc449dcc-dd73-4ce4-83ad-05cd92f076a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.382695 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-bc449dcc-dd73-4ce4-83ad-05cd92f076a9 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:12.383917 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-bc449dcc-dd73-4ce4-83ad-05cd92f076a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:12.391564 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 513/1033] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:13:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:12.634348 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6284fdb-2561-4d70-96db-d3f276a2de9f None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:12.648048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6284fdb-2561-4d70-96db-d3f276a2de9f None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:12.653069 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb06b84-8e35-401f-b326-ac5900f5d226 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:12.653653 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb06b84-8e35-401f-b326-ac5900f5d226 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:12.653933 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb06b84-8e35-401f-b326-ac5900f5d226 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:12.654205 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb06b84-8e35-401f-b326-ac5900f5d226 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:12.662925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb06b84-8e35-401f-b326-ac5900f5d226 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:12.664541 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb06b84-8e35-401f-b326-ac5900f5d226 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:12.674520 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 521/1034] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:13.564960 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510a18c-e88e-4de3-acf1-0452d52b0b38 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.565492 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510a18c-e88e-4de3-acf1-0452d52b0b38 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.565492 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510a18c-e88e-4de3-acf1-0452d52b0b38 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.566724 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 514/1035] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:13.571715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c7d1c-e258-45ee-8c2c-3f45d44b392c None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.572171 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c7d1c-e258-45ee-8c2c-3f45d44b392c None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.572278 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c7d1c-e258-45ee-8c2c-3f45d44b392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.591774 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-928c7d1c-e258-45ee-8c2c-3f45d44b392c None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:13.592995 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-928c7d1c-e258-45ee-8c2c-3f45d44b392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:13.601779 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 522/1036] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:13:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:13.756996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510a18c-e88e-4de3-acf1-0452d52b0b38 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:13.771122 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510a18c-e88e-4de3-acf1-0452d52b0b38 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:13.776073 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a63c6-9c14-430f-8a63-0eafed379d26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:13.776668 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a63c6-9c14-430f-8a63-0eafed379d26 service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:13.776950 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a63c6-9c14-430f-8a63-0eafed379d26 service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:13.777224 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a63c6-9c14-430f-8a63-0eafed379d26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:13.786062 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a63c6-9c14-430f-8a63-0eafed379d26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:13.787654 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a63c6-9c14-430f-8a63-0eafed379d26 service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:13.797097 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 515/1037] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:14.671817 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c1c50-6bc4-406d-9ca9-5ff028d117be None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.672379 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c1c50-6bc4-406d-9ca9-5ff028d117be None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.672379 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c1c50-6bc4-406d-9ca9-5ff028d117be None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.673662 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 523/1038] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:14.678450 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b30a5-553b-4ea8-88d4-f3174c085a14 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.678940 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b30a5-553b-4ea8-88d4-f3174c085a14 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.679050 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b30a5-553b-4ea8-88d4-f3174c085a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.698669 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-381b30a5-553b-4ea8-88d4-f3174c085a14 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:14.699881 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-381b30a5-553b-4ea8-88d4-f3174c085a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:14.708501 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 516/1039] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:13:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:14.864977 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c1c50-6bc4-406d-9ca9-5ff028d117be None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:14.878543 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c1c50-6bc4-406d-9ca9-5ff028d117be None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:14.883344 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06ecb1-1292-4088-a513-488c0bb03c05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:14.883957 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06ecb1-1292-4088-a513-488c0bb03c05 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:14.884237 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06ecb1-1292-4088-a513-488c0bb03c05 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:14.884507 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06ecb1-1292-4088-a513-488c0bb03c05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:14.892650 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06ecb1-1292-4088-a513-488c0bb03c05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:14.894351 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06ecb1-1292-4088-a513-488c0bb03c05 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:14.903507 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 524/1040] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:15.772390 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b99f0-2f02-4515-81f7-bea6bc352a43 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.772969 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b99f0-2f02-4515-81f7-bea6bc352a43 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.772969 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b99f0-2f02-4515-81f7-bea6bc352a43 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.774296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 517/1041] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:15.779219 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cc992-bf1a-4ebe-9fa1-99fb137952f5 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.779625 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cc992-bf1a-4ebe-9fa1-99fb137952f5 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.779751 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cc992-bf1a-4ebe-9fa1-99fb137952f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.799357 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-663cc992-bf1a-4ebe-9fa1-99fb137952f5 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:15.800569 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-663cc992-bf1a-4ebe-9fa1-99fb137952f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:15.808246 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 525/1042] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:13:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:15.965541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b99f0-2f02-4515-81f7-bea6bc352a43 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:15.979520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b99f0-2f02-4515-81f7-bea6bc352a43 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:15.984356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899480d0-d048-4c73-ab60-10594d9c893f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:15.984940 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899480d0-d048-4c73-ab60-10594d9c893f service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:15.985217 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899480d0-d048-4c73-ab60-10594d9c893f service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:15.985484 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899480d0-d048-4c73-ab60-10594d9c893f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:15.993904 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899480d0-d048-4c73-ab60-10594d9c893f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:15.995508 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899480d0-d048-4c73-ab60-10594d9c893f service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:16.006398 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 518/1043] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:16.820594 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d77741-386d-4e94-bf6c-0baaeef5d25e None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.821162 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d77741-386d-4e94-bf6c-0baaeef5d25e None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.821162 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d77741-386d-4e94-bf6c-0baaeef5d25e None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.822478 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 526/1044] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:16.827372 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d36f6-b04d-4e81-ab85-ed6faff7292e None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:16.827801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d36f6-b04d-4e81-ab85-ed6faff7292e None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:16.827930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d36f6-b04d-4e81-ab85-ed6faff7292e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:16.848650 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-8d6d36f6-b04d-4e81-ab85-ed6faff7292e None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:16.849849 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-8d6d36f6-b04d-4e81-ab85-ed6faff7292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:16.857886 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 519/1045] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:13:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:17.018315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d77741-386d-4e94-bf6c-0baaeef5d25e None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:17.031632 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d77741-386d-4e94-bf6c-0baaeef5d25e None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:17.037342 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267933d-4824-4dec-9df8-0efeb2009c4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:17.037936 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267933d-4824-4dec-9df8-0efeb2009c4f service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.038217 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267933d-4824-4dec-9df8-0efeb2009c4f service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.038492 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267933d-4824-4dec-9df8-0efeb2009c4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.046522 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267933d-4824-4dec-9df8-0efeb2009c4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:17.048129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267933d-4824-4dec-9df8-0efeb2009c4f service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:17.058283 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 527/1046] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:17.873168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54c30a-06f2-4f9b-8696-592b668576a8 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.873751 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54c30a-06f2-4f9b-8696-592b668576a8 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.873751 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54c30a-06f2-4f9b-8696-592b668576a8 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.875072 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 520/1047] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:17.880255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd6066-1862-422d-9de6-05342a3b4e50 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:17.880690 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd6066-1862-422d-9de6-05342a3b4e50 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:17.880827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd6066-1862-422d-9de6-05342a3b4e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:17.899508 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-4cdd6066-1862-422d-9de6-05342a3b4e50 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:17.900719 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-4cdd6066-1862-422d-9de6-05342a3b4e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:17.908817 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 528/1048] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:13:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:18.063221 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54c30a-06f2-4f9b-8696-592b668576a8 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:18.076586 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54c30a-06f2-4f9b-8696-592b668576a8 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:18.082176 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247b797-1b39-45a2-a693-3e6d3ace2a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:18.082767 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247b797-1b39-45a2-a693-3e6d3ace2a76 service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.083042 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247b797-1b39-45a2-a693-3e6d3ace2a76 service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.083314 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247b797-1b39-45a2-a693-3e6d3ace2a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.091177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247b797-1b39-45a2-a693-3e6d3ace2a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:18.092777 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247b797-1b39-45a2-a693-3e6d3ace2a76 service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:18.102979 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 521/1049] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:18.918505 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604aca7-8252-472e-a9d7-d68525c03311 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.919018 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604aca7-8252-472e-a9d7-d68525c03311 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.919137 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604aca7-8252-472e-a9d7-d68525c03311 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.920437 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 529/1050] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:13:18.925687 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d684c-c04f-4bd3-949a-459cca10153a None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:18.926099 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d684c-c04f-4bd3-949a-459cca10153a None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:18.926279 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d684c-c04f-4bd3-949a-459cca10153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:18.945319 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-311d684c-c04f-4bd3-949a-459cca10153a None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:18.946512 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-311d684c-c04f-4bd3-949a-459cca10153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:18.954484 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 522/1051] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:13:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:19.114274 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604aca7-8252-472e-a9d7-d68525c03311 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:19.127784 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604aca7-8252-472e-a9d7-d68525c03311 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:19.132722 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf053a5-76b2-4661-87e8-d4b3d144fe82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:19.133308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf053a5-76b2-4661-87e8-d4b3d144fe82 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.133584 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf053a5-76b2-4661-87e8-d4b3d144fe82 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.133856 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf053a5-76b2-4661-87e8-d4b3d144fe82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.141850 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf053a5-76b2-4661-87e8-d4b3d144fe82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:19.143534 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf053a5-76b2-4661-87e8-d4b3d144fe82 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:19.153051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 530/1052] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:19.975108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987125-a3c7-4e93-addc-1fadd32ddb7f None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.975663 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987125-a3c7-4e93-addc-1fadd32ddb7f None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.975663 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987125-a3c7-4e93-addc-1fadd32ddb7f None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:19.977014 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 523/1053] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:19.981839 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87dfd1-32c2-46b2-a163-8c07813cfbe6 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:19.982257 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87dfd1-32c2-46b2-a163-8c07813cfbe6 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:19.982468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87dfd1-32c2-46b2-a163-8c07813cfbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:20.002239 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-ac87dfd1-32c2-46b2-a163-8c07813cfbe6 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:20.003760 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-ac87dfd1-32c2-46b2-a163-8c07813cfbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:20.011634 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 531/1054] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:13:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:20.170207 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10987125-a3c7-4e93-addc-1fadd32ddb7f None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:20.183854 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10987125-a3c7-4e93-addc-1fadd32ddb7f None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:20.190375 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80870064-fbbb-4abd-8ab8-d3ebd920cb5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:20.190932 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870064-fbbb-4abd-8ab8-d3ebd920cb5f service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:20.191208 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870064-fbbb-4abd-8ab8-d3ebd920cb5f service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:20.191473 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80870064-fbbb-4abd-8ab8-d3ebd920cb5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:20.199637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80870064-fbbb-4abd-8ab8-d3ebd920cb5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:20.201242 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80870064-fbbb-4abd-8ab8-d3ebd920cb5f service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:20.211620 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 524/1055] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:22.266243 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16e4af-045f-4de9-bce3-fc5bf563df6a None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.266775 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16e4af-045f-4de9-bce3-fc5bf563df6a None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.266775 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16e4af-045f-4de9-bce3-fc5bf563df6a None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.268233 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 532/1056] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:22.273449 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210e161-2a49-45ff-bd24-fc44ac9e3f60 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.273869 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210e161-2a49-45ff-bd24-fc44ac9e3f60 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.274086 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210e161-2a49-45ff-bd24-fc44ac9e3f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.293679 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-b210e161-2a49-45ff-bd24-fc44ac9e3f60 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:22.294868 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-b210e161-2a49-45ff-bd24-fc44ac9e3f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:22.304141 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 525/1057] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:13:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:22.644250 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16e4af-045f-4de9-bce3-fc5bf563df6a None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:22.654753 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16e4af-045f-4de9-bce3-fc5bf563df6a None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:22.658436 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3acf46-64aa-4a49-aca8-15c77705e79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:22.659070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3acf46-64aa-4a49-aca8-15c77705e79a service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:22.659351 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3acf46-64aa-4a49-aca8-15c77705e79a service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:22.659623 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3acf46-64aa-4a49-aca8-15c77705e79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:22.668394 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3acf46-64aa-4a49-aca8-15c77705e79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:22.669819 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3acf46-64aa-4a49-aca8-15c77705e79a service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:22.679519 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 533/1058] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:25.026346 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0abcef-17ba-4e8e-a187-1c8993de58bf None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:25.026904 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0abcef-17ba-4e8e-a187-1c8993de58bf None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:25.026904 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0abcef-17ba-4e8e-a187-1c8993de58bf None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:25.028224 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 526/1059] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:25.034036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c78dad-a97a-4cab-a090-f86d6874a526 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:25.034474 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c78dad-a97a-4cab-a090-f86d6874a526 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:25.034697 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c78dad-a97a-4cab-a090-f86d6874a526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:25.053869 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-39c78dad-a97a-4cab-a090-f86d6874a526 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:25.055066 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-39c78dad-a97a-4cab-a090-f86d6874a526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:25.062863 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 534/1060] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:13:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:25.405430 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0abcef-17ba-4e8e-a187-1c8993de58bf None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:25.417503 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0abcef-17ba-4e8e-a187-1c8993de58bf None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:25.420990 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f23ba-80d5-4b05-b1fa-c9c7f7e2f1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:25.421583 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f23ba-80d5-4b05-b1fa-c9c7f7e2f1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:25.421864 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f23ba-80d5-4b05-b1fa-c9c7f7e2f1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:25.422141 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f23ba-80d5-4b05-b1fa-c9c7f7e2f1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:25.431794 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f23ba-80d5-4b05-b1fa-c9c7f7e2f1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:25.433253 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f23ba-80d5-4b05-b1fa-c9c7f7e2f1a9 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:25.443071 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 527/1061] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:28.187578 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750d892-49f2-4c2d-920e-61f6f4220025 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:28.188151 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750d892-49f2-4c2d-920e-61f6f4220025 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:28.188248 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750d892-49f2-4c2d-920e-61f6f4220025 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:28.190132 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 535/1062] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:28.195818 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68949f90-0a77-44ca-a354-ad6b71beaa99 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:28.196294 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68949f90-0a77-44ca-a354-ad6b71beaa99 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:28.196415 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68949f90-0a77-44ca-a354-ad6b71beaa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:28.216149 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-68949f90-0a77-44ca-a354-ad6b71beaa99 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:28.217339 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-68949f90-0a77-44ca-a354-ad6b71beaa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:28.226521 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 528/1063] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:13:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:28.575685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750d892-49f2-4c2d-920e-61f6f4220025 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:28.587001 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750d892-49f2-4c2d-920e-61f6f4220025 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:28.590602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da85cd0-27a0-41d8-bcb8-8c5855ecb0c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:28.591191 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da85cd0-27a0-41d8-bcb8-8c5855ecb0c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:28.591468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da85cd0-27a0-41d8-bcb8-8c5855ecb0c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:28.591738 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da85cd0-27a0-41d8-bcb8-8c5855ecb0c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:28.601527 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da85cd0-27a0-41d8-bcb8-8c5855ecb0c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:28.602950 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da85cd0-27a0-41d8-bcb8-8c5855ecb0c3 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:28.612879 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 536/1064] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:30.920516 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29db52d-2e0f-4b78-b857-190b3907e0ce None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:30.921067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29db52d-2e0f-4b78-b857-190b3907e0ce None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:30.921067 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29db52d-2e0f-4b78-b857-190b3907e0ce None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:30.922358 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 529/1065] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:30.928278 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51be6b0-a071-4faf-aeae-3aadf958d357 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:30.928661 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51be6b0-a071-4faf-aeae-3aadf958d357 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:30.928838 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51be6b0-a071-4faf-aeae-3aadf958d357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:30.948142 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-b51be6b0-a071-4faf-aeae-3aadf958d357 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:30.949349 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-b51be6b0-a071-4faf-aeae-3aadf958d357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:30.957241 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 537/1066] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:13:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:31.327530 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9b98f-2003-48ba-b680-e5d9f42ec45f None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:31.327814 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9b98f-2003-48ba-b680-e5d9f42ec45f None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:31.328129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9b98f-2003-48ba-b680-e5d9f42ec45f None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:31.329500 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 530/1067] 10.222.0.58 () {54 vars in 965 bytes} [Tue Aug 23 22:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:31.335981 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d2675-f121-48c4-85af-ae0a4ad432f1 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:31.336273 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d2675-f121-48c4-85af-ae0a4ad432f1 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:31.336551 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d2675-f121-48c4-85af-ae0a4ad432f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:31.357267 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-522d2675-f121-48c4-85af-ae0a4ad432f1 None None] MFA Rules not processed for user `b57524e5da8647a1a258f8c1e4258b62`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:31.358448 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-522d2675-f121-48c4-85af-ae0a4ad432f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:31.366340 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 538/1068] 10.222.0.58 () {58 vars in 1062 bytes} [Tue Aug 23 22:13:31 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:31.375118 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9b98f-2003-48ba-b680-e5d9f42ec45f None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:31.386558 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9b98f-2003-48ba-b680-e5d9f42ec45f None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:31.390077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23269e1-c876-4c30-a866-599ea10bb391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:31.390666 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23269e1-c876-4c30-a866-599ea10bb391 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:31.390945 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23269e1-c876-4c30-a866-599ea10bb391 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:31.391216 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23269e1-c876-4c30-a866-599ea10bb391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:31.400758 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23269e1-c876-4c30-a866-599ea10bb391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:31.402184 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23269e1-c876-4c30-a866-599ea10bb391 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:31.411603 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 531/1069] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:34.153088 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027ba10-e15c-4a86-9ff3-e5568f32da6c None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:34.153620 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027ba10-e15c-4a86-9ff3-e5568f32da6c None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:34.153745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027ba10-e15c-4a86-9ff3-e5568f32da6c None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:34.155047 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 539/1070] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:34.160420 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd81584-5a9c-4402-88c1-2909ace79cf2 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:34.160805 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd81584-5a9c-4402-88c1-2909ace79cf2 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:34.160978 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd81584-5a9c-4402-88c1-2909ace79cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:34.179711 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-6bd81584-5a9c-4402-88c1-2909ace79cf2 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:34.180946 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-6bd81584-5a9c-4402-88c1-2909ace79cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:34.188639 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 532/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:13:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:13:34.534806 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027ba10-e15c-4a86-9ff3-e5568f32da6c None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:34.545289 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027ba10-e15c-4a86-9ff3-e5568f32da6c None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:34.548769 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec98bd-0bd4-44f6-bb6c-591257c56039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:34.549809 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec98bd-0bd4-44f6-bb6c-591257c56039 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:34.550087 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec98bd-0bd4-44f6-bb6c-591257c56039 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:34.550356 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec98bd-0bd4-44f6-bb6c-591257c56039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:34.558978 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec98bd-0bd4-44f6-bb6c-591257c56039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:34.560453 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec98bd-0bd4-44f6-bb6c-591257c56039 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:34.570207 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 540/1072] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:36.899574 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a93218-6809-441b-8701-0868e1c88659 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.900154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a93218-6809-441b-8701-0868e1c88659 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.900154 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a93218-6809-441b-8701-0868e1c88659 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.901502 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 533/1073] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:36.906823 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24baf4-e4fc-408c-adaa-b9eda53bbce8 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:36.907250 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24baf4-e4fc-408c-adaa-b9eda53bbce8 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:36.907357 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24baf4-e4fc-408c-adaa-b9eda53bbce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:36.914712 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=73 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:36.927706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-0e24baf4-e4fc-408c-adaa-b9eda53bbce8 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:36.929027 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-0e24baf4-e4fc-408c-adaa-b9eda53bbce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:36.936993 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 541/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:13:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:37.283380 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a93218-6809-441b-8701-0868e1c88659 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:37.288824 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=64 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:37.295019 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a93218-6809-441b-8701-0868e1c88659 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:37.298444 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0cedb-ccf3-4ce0-95a4-b5d84d08cc8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:37.299092 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0cedb-ccf3-4ce0-95a4-b5d84d08cc8d service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:37.299366 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0cedb-ccf3-4ce0-95a4-b5d84d08cc8d service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:37.299641 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0cedb-ccf3-4ce0-95a4-b5d84d08cc8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:37.308502 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0cedb-ccf3-4ce0-95a4-b5d84d08cc8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:37.309917 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0cedb-ccf3-4ce0-95a4-b5d84d08cc8d service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:37.319634 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 534/1075] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:39.563547 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8f224-c415-46cf-a2c9-14e22fa62224 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:39.564123 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8f224-c415-46cf-a2c9-14e22fa62224 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:39.564123 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8f224-c415-46cf-a2c9-14e22fa62224 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:39.566328 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 542/1076] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:39.571788 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b003423-e9d9-47f7-bc43-4eeaa86f1788 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:39.572294 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b003423-e9d9-47f7-bc43-4eeaa86f1788 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:39.572417 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b003423-e9d9-47f7-bc43-4eeaa86f1788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:39.594784 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-9b003423-e9d9-47f7-bc43-4eeaa86f1788 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:39.596714 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-9b003423-e9d9-47f7-bc43-4eeaa86f1788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:39.605040 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 535/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:13:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:39.957109 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8f224-c415-46cf-a2c9-14e22fa62224 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:39.968272 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8f224-c415-46cf-a2c9-14e22fa62224 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:39.972703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e414d15-bdf8-4ad7-824f-2cb345457c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:39.973299 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e414d15-bdf8-4ad7-824f-2cb345457c2f service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:39.973577 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e414d15-bdf8-4ad7-824f-2cb345457c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:39.973848 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e414d15-bdf8-4ad7-824f-2cb345457c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:39.982713 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e414d15-bdf8-4ad7-824f-2cb345457c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:39.984159 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e414d15-bdf8-4ad7-824f-2cb345457c2f service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:39.994298 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 543/1078] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:42.243038 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bafb7-516d-445c-8ae1-468b321725b8 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:42.243469 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bafb7-516d-445c-8ae1-468b321725b8 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:42.243575 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bafb7-516d-445c-8ae1-468b321725b8 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:42.244945 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 536/1079] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:42.250314 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33343b98-07c2-4b2f-be9d-252ac3bb5ac1 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:42.250755 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33343b98-07c2-4b2f-be9d-252ac3bb5ac1 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:42.250866 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33343b98-07c2-4b2f-be9d-252ac3bb5ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:42.271106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-33343b98-07c2-4b2f-be9d-252ac3bb5ac1 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:42.272339 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-33343b98-07c2-4b2f-be9d-252ac3bb5ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:42.280194 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 544/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:13:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:42.620868 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bafb7-516d-445c-8ae1-468b321725b8 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:42.632325 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bafb7-516d-445c-8ae1-468b321725b8 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:42.635865 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f33f6-b576-48ef-9f97-497735c59f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:42.636481 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f33f6-b576-48ef-9f97-497735c59f09 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:42.636768 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f33f6-b576-48ef-9f97-497735c59f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:42.637047 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f33f6-b576-48ef-9f97-497735c59f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:42.646571 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f33f6-b576-48ef-9f97-497735c59f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:42.648069 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f33f6-b576-48ef-9f97-497735c59f09 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:42.657377 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 537/1081] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:44.898410 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3b7f2-589c-4701-b1e6-e35a40b71e4a None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:44.898924 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3b7f2-589c-4701-b1e6-e35a40b71e4a None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:44.899025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3b7f2-589c-4701-b1e6-e35a40b71e4a None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:44.900336 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 545/1082] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:44.905678 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ae9bf-f952-4092-9534-32c240a36e12 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:44.906129 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ae9bf-f952-4092-9534-32c240a36e12 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:44.906226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ae9bf-f952-4092-9534-32c240a36e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:44.926334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-a55ae9bf-f952-4092-9534-32c240a36e12 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:44.927525 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-a55ae9bf-f952-4092-9534-32c240a36e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:44.935258 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 538/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:13:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:45.288777 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3b7f2-589c-4701-b1e6-e35a40b71e4a None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:45.299550 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3b7f2-589c-4701-b1e6-e35a40b71e4a None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:45.303032 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c07522-9b16-412b-aeed-2c59c5edbbb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:45.303613 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c07522-9b16-412b-aeed-2c59c5edbbb1 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:45.303919 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c07522-9b16-412b-aeed-2c59c5edbbb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:45.304192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c07522-9b16-412b-aeed-2c59c5edbbb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:45.312885 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c07522-9b16-412b-aeed-2c59c5edbbb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:45.314308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c07522-9b16-412b-aeed-2c59c5edbbb1 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:45.323857 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 546/1084] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:47.539517 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997a493-b628-4a97-9fd4-808b6a8791ca None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:47.540077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997a493-b628-4a97-9fd4-808b6a8791ca None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:47.540077 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997a493-b628-4a97-9fd4-808b6a8791ca None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:47.541337 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 539/1085] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:13:47.546700 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821045-370b-44f7-853c-06777615d782 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:47.547105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821045-370b-44f7-853c-06777615d782 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:47.547247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821045-370b-44f7-853c-06777615d782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:47.567439 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-7b821045-370b-44f7-853c-06777615d782 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:13:47.568659 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-7b821045-370b-44f7-853c-06777615d782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:13:47.576278 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 547/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:13:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:13:47.921221 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997a493-b628-4a97-9fd4-808b6a8791ca None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:13:47.932262 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997a493-b628-4a97-9fd4-808b6a8791ca None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:13:47.935764 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19aa09-25ec-42e5-9947-326e63ab516c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:13:47.936387 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19aa09-25ec-42e5-9947-326e63ab516c service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:13:47.936673 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19aa09-25ec-42e5-9947-326e63ab516c service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:13:47.936947 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19aa09-25ec-42e5-9947-326e63ab516c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:13:47.946718 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19aa09-25ec-42e5-9947-326e63ab516c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:13:47.948199 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19aa09-25ec-42e5-9947-326e63ab516c service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:13:47.958685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 540/1087] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:13:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:13:57.561983 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=20 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:13:57.953517 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=23 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:12.192419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03a6b0-762d-4337-ae9e-076a6e1e8cb7 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.193070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03a6b0-762d-4337-ae9e-076a6e1e8cb7 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.193070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03a6b0-762d-4337-ae9e-076a6e1e8cb7 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.194324 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 548/1088] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:12.199563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ac1a6-36c4-4020-af19-677d7ef24efb None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.200074 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ac1a6-36c4-4020-af19-677d7ef24efb None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.200174 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ac1a6-36c4-4020-af19-677d7ef24efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.218904 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-0a7ac1a6-36c4-4020-af19-677d7ef24efb None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:12.220251 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-0a7ac1a6-36c4-4020-af19-677d7ef24efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:12.228772 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 541/1089] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:14:12.585223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef608cf-5ab5-41c9-a4d1-8aec59b40c7f None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.585508 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef608cf-5ab5-41c9-a4d1-8aec59b40c7f None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.585786 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef608cf-5ab5-41c9-a4d1-8aec59b40c7f None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.587094 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 549/1090] 10.222.0.58 () {54 vars in 967 bytes} [Tue Aug 23 22:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:12.592185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11150427-b7ee-4e7b-a5c5-786d534d3ce5 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.592470 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11150427-b7ee-4e7b-a5c5-786d534d3ce5 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.592741 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11150427-b7ee-4e7b-a5c5-786d534d3ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.616663 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-11150427-b7ee-4e7b-a5c5-786d534d3ce5 None None] MFA Rules not processed for user `18eb03a1a720431a9c78883a0aab8741`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:12.617852 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-11150427-b7ee-4e7b-a5c5-786d534d3ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:12.624188 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 542/1091] 10.222.0.58 () {58 vars in 1064 bytes} [Tue Aug 23 22:14:12 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:14:12.631465 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef608cf-5ab5-41c9-a4d1-8aec59b40c7f None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:12.642075 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef608cf-5ab5-41c9-a4d1-8aec59b40c7f None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:12.645575 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa6485-6330-439f-918f-29b8e87f6e68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18eb03a1a720431a9c78883a0aab8741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:12.646163 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa6485-6330-439f-918f-29b8e87f6e68 service glance] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:12.646442 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa6485-6330-439f-918f-29b8e87f6e68 service glance] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:12.646715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa6485-6330-439f-918f-29b8e87f6e68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:12.655512 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa6485-6330-439f-918f-29b8e87f6e68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:12.656963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa6485-6330-439f-918f-29b8e87f6e68 service glance] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:12.666753 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 550/1092] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:14:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:14:14.981384 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4641d4d-becd-4dd4-9eb2-56788b678240 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:14.981936 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4641d4d-becd-4dd4-9eb2-56788b678240 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:14.981936 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4641d4d-becd-4dd4-9eb2-56788b678240 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:14.983314 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 543/1093] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:14.988652 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab691-c322-48e5-b105-8e28323221fe None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:14.989101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab691-c322-48e5-b105-8e28323221fe None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:14.989199 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab691-c322-48e5-b105-8e28323221fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:15.008361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-b56ab691-c322-48e5-b105-8e28323221fe None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:15.009555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-b56ab691-c322-48e5-b105-8e28323221fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:15.017332 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 551/1094] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:14:15.350844 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4641d4d-becd-4dd4-9eb2-56788b678240 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:15.364111 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4641d4d-becd-4dd4-9eb2-56788b678240 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:15.368781 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b57d6-d201-445f-84d1-5713422c5e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:15.369382 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b57d6-d201-445f-84d1-5713422c5e6c admin admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:15.369663 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b57d6-d201-445f-84d1-5713422c5e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:15.369935 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b57d6-d201-445f-84d1-5713422c5e6c admin admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:15.370570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b57d6-d201-445f-84d1-5713422c5e6c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:15.372357 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: WARNING py.warnings [None req-9c8b57d6-d201-445f-84d1-5713422c5e6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:14:15.372357 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: warnings.warn(msg) Aug 23 22:14:15.372357 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: Aug 23 22:14:15.373580 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b57d6-d201-445f-84d1-5713422c5e6c admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:15.393712 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 544/1095] 10.222.0.58 () {56 vars in 1108 bytes} [Tue Aug 23 22:14:15 2022] GET /identity/v3/projects => generated 1606 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:14:17.643788 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d036a7-3e2c-40f9-ae4f-0bcd1c37c9f3 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:17.644353 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d036a7-3e2c-40f9-ae4f-0bcd1c37c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:17.644465 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d036a7-3e2c-40f9-ae4f-0bcd1c37c9f3 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:17.645800 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 552/1096] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:14:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:14:17.651087 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9342e4-22bf-4bb8-a304-064fb5489d77 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:17.651493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9342e4-22bf-4bb8-a304-064fb5489d77 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:17.651627 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9342e4-22bf-4bb8-a304-064fb5489d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:17.670728 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-fc9342e4-22bf-4bb8-a304-064fb5489d77 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:17.671930 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-fc9342e4-22bf-4bb8-a304-064fb5489d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:17.679777 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 545/1097] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:14:18.037299 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d036a7-3e2c-40f9-ae4f-0bcd1c37c9f3 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:18.051623 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d036a7-3e2c-40f9-ae4f-0bcd1c37c9f3 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:18.056595 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf985f9-ca86-4550-9484-d3216254e67e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:18.057185 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf985f9-ca86-4550-9484-d3216254e67e service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:18.057467 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf985f9-ca86-4550-9484-d3216254e67e service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:18.057741 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf985f9-ca86-4550-9484-d3216254e67e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:18.066417 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf985f9-ca86-4550-9484-d3216254e67e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:18.068025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf985f9-ca86-4550-9484-d3216254e67e service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:18.077618 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 553/1098] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:14:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:14:20.453749 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c59b6-6812-4a96-b14b-0ee236d0a446 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:20.454347 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c59b6-6812-4a96-b14b-0ee236d0a446 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:20.454347 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c59b6-6812-4a96-b14b-0ee236d0a446 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:20.455778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 546/1099] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:20.460895 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f577c-ad60-47d7-a1f8-83b2f1463eaa None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:20.461314 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f577c-ad60-47d7-a1f8-83b2f1463eaa None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:20.461449 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f577c-ad60-47d7-a1f8-83b2f1463eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:20.480888 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-192f577c-ad60-47d7-a1f8-83b2f1463eaa None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:20.482101 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-192f577c-ad60-47d7-a1f8-83b2f1463eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:20.490446 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 554/1100] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:14:20.842461 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c59b6-6812-4a96-b14b-0ee236d0a446 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:20.854081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c59b6-6812-4a96-b14b-0ee236d0a446 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:20.857626 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c90c68-5163-4bf4-89ee-f18d1997a1a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:20.858218 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c90c68-5163-4bf4-89ee-f18d1997a1a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:20.858499 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c90c68-5163-4bf4-89ee-f18d1997a1a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:20.858769 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c90c68-5163-4bf4-89ee-f18d1997a1a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:20.868292 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c90c68-5163-4bf4-89ee-f18d1997a1a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:20.869994 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c90c68-5163-4bf4-89ee-f18d1997a1a0 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:20.879313 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 547/1101] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:14:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:14:23.115614 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9008bbf-704a-42d7-ab6e-ab521bea1158 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:23.116207 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9008bbf-704a-42d7-ab6e-ab521bea1158 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:23.116207 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9008bbf-704a-42d7-ab6e-ab521bea1158 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:23.117440 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 555/1102] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:23.122681 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcf568-e9be-4be5-9400-91b7a9c04c2e None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:23.123118 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcf568-e9be-4be5-9400-91b7a9c04c2e None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:23.123233 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcf568-e9be-4be5-9400-91b7a9c04c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:23.142356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-83dcf568-e9be-4be5-9400-91b7a9c04c2e None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:23.144227 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-83dcf568-e9be-4be5-9400-91b7a9c04c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:23.151957 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 548/1103] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:14:23.505779 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9008bbf-704a-42d7-ab6e-ab521bea1158 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:23.516315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9008bbf-704a-42d7-ab6e-ab521bea1158 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:23.519981 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc2901-1d35-4d80-acd9-3465bbc6f829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:23.520570 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc2901-1d35-4d80-acd9-3465bbc6f829 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:23.520846 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc2901-1d35-4d80-acd9-3465bbc6f829 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:23.521116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc2901-1d35-4d80-acd9-3465bbc6f829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:23.529760 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc2901-1d35-4d80-acd9-3465bbc6f829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:23.531209 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc2901-1d35-4d80-acd9-3465bbc6f829 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:23.541062 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 556/1104] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:14:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:14:25.921811 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5fa2c-1954-4005-90f7-22e537517665 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:25.922421 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5fa2c-1954-4005-90f7-22e537517665 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:25.922421 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5fa2c-1954-4005-90f7-22e537517665 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:25.923716 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 549/1105] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:25.929056 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c09c9-88c9-4982-bc7d-b51dbc1ebf5f None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:25.929479 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c09c9-88c9-4982-bc7d-b51dbc1ebf5f None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:25.929590 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c09c9-88c9-4982-bc7d-b51dbc1ebf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:25.948818 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-223c09c9-88c9-4982-bc7d-b51dbc1ebf5f None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:25.950002 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-223c09c9-88c9-4982-bc7d-b51dbc1ebf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:25.958378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 557/1106] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:14:26.310084 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5fa2c-1954-4005-90f7-22e537517665 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:26.321473 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5fa2c-1954-4005-90f7-22e537517665 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:26.324973 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85c530-2ef0-4b3e-82f8-5369ed2ba707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:26.325562 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85c530-2ef0-4b3e-82f8-5369ed2ba707 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:26.325839 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85c530-2ef0-4b3e-82f8-5369ed2ba707 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:26.326108 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85c530-2ef0-4b3e-82f8-5369ed2ba707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:26.335636 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85c530-2ef0-4b3e-82f8-5369ed2ba707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:26.337106 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85c530-2ef0-4b3e-82f8-5369ed2ba707 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:26.347047 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 550/1107] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:14:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:14:28.753302 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c872d4-5d08-4b61-aef5-beed7db38015 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:28.753864 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c872d4-5d08-4b61-aef5-beed7db38015 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:28.753864 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c872d4-5d08-4b61-aef5-beed7db38015 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:28.755220 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 558/1108] 10.222.0.58 () {54 vars in 927 bytes} [Tue Aug 23 22:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:14:28.760562 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7dfba-2a84-4ca2-893d-d1bd44785003 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:28.760993 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7dfba-2a84-4ca2-893d-d1bd44785003 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:28.761142 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7dfba-2a84-4ca2-893d-d1bd44785003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:28.782262 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-bdf7dfba-2a84-4ca2-893d-d1bd44785003 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:14:28.784087 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-bdf7dfba-2a84-4ca2-893d-d1bd44785003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:14:28.791764 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 551/1109] 10.222.0.58 () {58 vars in 1024 bytes} [Tue Aug 23 22:14:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:14:29.144415 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c872d4-5d08-4b61-aef5-beed7db38015 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:14:29.155122 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c872d4-5d08-4b61-aef5-beed7db38015 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:14:29.159176 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dca5c-4a3b-4b2e-a106-0cff8abb167d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:14:29.159769 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dca5c-4a3b-4b2e-a106-0cff8abb167d service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:14:29.160076 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dca5c-4a3b-4b2e-a106-0cff8abb167d service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:14:29.160344 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dca5c-4a3b-4b2e-a106-0cff8abb167d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:14:29.169148 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9dca5c-4a3b-4b2e-a106-0cff8abb167d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:14:29.170584 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9dca5c-4a3b-4b2e-a106-0cff8abb167d service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:14:29.180609 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 559/1110] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:14:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:14:38.777663 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=33 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:14:39.176521 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=33 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:42.410306 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575aed-253e-4550-8c5d-62d4dbe5a15c None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:42.410910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575aed-253e-4550-8c5d-62d4dbe5a15c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:42.410910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575aed-253e-4550-8c5d-62d4dbe5a15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:42.430684 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-de575aed-253e-4550-8c5d-62d4dbe5a15c None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:42.431884 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-de575aed-253e-4550-8c5d-62d4dbe5a15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:42.439493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 552/1111] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:15:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:42.447979 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0963a-c715-49c2-82bb-d3830479acdf None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:42.448495 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0963a-c715-49c2-82bb-d3830479acdf None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:42.448495 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0963a-c715-49c2-82bb-d3830479acdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:42.468566 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-81e0963a-c715-49c2-82bb-d3830479acdf None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:42.469759 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-81e0963a-c715-49c2-82bb-d3830479acdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:42.477961 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 560/1112] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:15:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:42.482557 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de575aed-253e-4550-8c5d-62d4dbe5a15c None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:42.493101 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de575aed-253e-4550-8c5d-62d4dbe5a15c None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:42.497516 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a172cc-1f12-4f05-b2be-c95af30f7888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:42.498118 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a172cc-1f12-4f05-b2be-c95af30f7888 admin admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:42.498378 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a172cc-1f12-4f05-b2be-c95af30f7888 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:42.498649 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a172cc-1f12-4f05-b2be-c95af30f7888 admin admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:42.499282 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a172cc-1f12-4f05-b2be-c95af30f7888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:15:42.499587 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a172cc-1f12-4f05-b2be-c95af30f7888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:42.500623 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: WARNING py.warnings [None req-a5a172cc-1f12-4f05-b2be-c95af30f7888 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:15:42.500623 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: warnings.warn(msg) Aug 23 22:15:42.500623 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: Aug 23 22:15:42.501532 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a172cc-1f12-4f05-b2be-c95af30f7888 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:42.513904 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 553/1113] 10.222.0.58 () {58 vars in 1153 bytes} [Tue Aug 23 22:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:15:42.522606 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0963a-c715-49c2-82bb-d3830479acdf None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:42.531712 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0963a-c715-49c2-82bb-d3830479acdf None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:42.536994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a89342-04c4-4b5a-9cb2-3984adbb3737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:42.537582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a89342-04c4-4b5a-9cb2-3984adbb3737 admin admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:42.537862 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a89342-04c4-4b5a-9cb2-3984adbb3737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:42.538135 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a89342-04c4-4b5a-9cb2-3984adbb3737 admin admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:42.538747 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a89342-04c4-4b5a-9cb2-3984adbb3737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:42.540526 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: WARNING py.warnings [None req-55a89342-04c4-4b5a-9cb2-3984adbb3737 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:15:42.540526 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: warnings.warn(msg) Aug 23 22:15:42.540526 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: Aug 23 22:15:42.541724 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a89342-04c4-4b5a-9cb2-3984adbb3737 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:42.569225 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 561/1114] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Aug 23 22:15:42 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:15:42.573426 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a172cc-1f12-4f05-b2be-c95af30f7888 admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:42.583345 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a172cc-1f12-4f05-b2be-c95af30f7888 admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:42.639887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1a787-c2f0-4d3b-8407-e23af23dd5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:42.640492 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1a787-c2f0-4d3b-8407-e23af23dd5cb admin admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:42.640778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1a787-c2f0-4d3b-8407-e23af23dd5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:42.641052 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f1a787-c2f0-4d3b-8407-e23af23dd5cb admin admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:42.641675 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1a787-c2f0-4d3b-8407-e23af23dd5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:42.642677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: WARNING py.warnings [None req-85f1a787-c2f0-4d3b-8407-e23af23dd5cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:15:42.642677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: warnings.warn(msg) Aug 23 22:15:42.642677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: Aug 23 22:15:42.643924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f1a787-c2f0-4d3b-8407-e23af23dd5cb admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:42.667264 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 554/1115] 10.222.0.58 () {60 vars in 1144 bytes} [Tue Aug 23 22:15:42 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:15:42.671408 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a89342-04c4-4b5a-9cb2-3984adbb3737 admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:42.681623 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a89342-04c4-4b5a-9cb2-3984adbb3737 admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:42.686255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab75c9c-9cfe-4cbd-b7a3-afbc765fa274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:42.686849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab75c9c-9cfe-4cbd-b7a3-afbc765fa274 admin admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:42.687129 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab75c9c-9cfe-4cbd-b7a3-afbc765fa274 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:42.687401 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab75c9c-9cfe-4cbd-b7a3-afbc765fa274 admin admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:42.688071 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab75c9c-9cfe-4cbd-b7a3-afbc765fa274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:42.689070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: WARNING py.warnings [None req-4ab75c9c-9cfe-4cbd-b7a3-afbc765fa274 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:15:42.689070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: warnings.warn(msg) Aug 23 22:15:42.689070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: Aug 23 22:15:42.689957 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab75c9c-9cfe-4cbd-b7a3-afbc765fa274 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:42.702386 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 562/1116] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Aug 23 22:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:15:42.706285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1a787-c2f0-4d3b-8407-e23af23dd5cb admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:42.717363 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f1a787-c2f0-4d3b-8407-e23af23dd5cb admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:42.721879 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31040aec-9900-4626-a6f5-4bfb7ae6ed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:42.722463 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31040aec-9900-4626-a6f5-4bfb7ae6ed31 admin admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:42.722741 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31040aec-9900-4626-a6f5-4bfb7ae6ed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:42.723011 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31040aec-9900-4626-a6f5-4bfb7ae6ed31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:42.724772 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31040aec-9900-4626-a6f5-4bfb7ae6ed31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:42.725781 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: WARNING py.warnings [None req-31040aec-9900-4626-a6f5-4bfb7ae6ed31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:15:42.725781 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: warnings.warn(msg) Aug 23 22:15:42.725781 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: Aug 23 22:15:42.726917 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31040aec-9900-4626-a6f5-4bfb7ae6ed31 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:42.740428 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 555/1117] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Aug 23 22:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:15:42.744627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab75c9c-9cfe-4cbd-b7a3-afbc765fa274 admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:42.755100 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab75c9c-9cfe-4cbd-b7a3-afbc765fa274 admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:42.760252 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef5e85-3e21-46af-8394-d95b242a14ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:42.760914 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef5e85-3e21-46af-8394-d95b242a14ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:42.761189 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef5e85-3e21-46af-8394-d95b242a14ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:42.761461 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef5e85-3e21-46af-8394-d95b242a14ac admin admin] PATH_INFO: `/v3/projects/2806744ff61c4d148c527fd160c2d85d/users/f5608f3e79aa4f199b11cfe9f1b821cb/roles/57d5f513f8fd4d7dbd1ef0ecc319892e` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:42.777932 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef5e85-3e21-46af-8394-d95b242a14ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2806744ff61c4d148c527fd160c2d85d, user_id=f5608f3e79aa4f199b11cfe9f1b821cb, role_id=57d5f513f8fd4d7dbd1ef0ecc319892e)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:42.778963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: WARNING py.warnings [None req-89ef5e85-3e21-46af-8394-d95b242a14ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:15:42.778963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: warnings.warn(msg) Aug 23 22:15:42.778963 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: Aug 23 22:15:42.780959 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef5e85-3e21-46af-8394-d95b242a14ac admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:42.795706 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 563/1118] 10.222.0.58 () {60 vars in 1483 bytes} [Tue Aug 23 22:15:42 2022] PUT /identity/v3/projects/2806744ff61c4d148c527fd160c2d85d/users/f5608f3e79aa4f199b11cfe9f1b821cb/roles/57d5f513f8fd4d7dbd1ef0ecc319892e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:15:42.808532 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597c6c3-f250-4318-8214-c7f7cbe6d656 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:42.808821 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597c6c3-f250-4318-8214-c7f7cbe6d656 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:42.809118 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597c6c3-f250-4318-8214-c7f7cbe6d656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:42.836543 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-c597c6c3-f250-4318-8214-c7f7cbe6d656 None None] MFA Rules not processed for user `f5608f3e79aa4f199b11cfe9f1b821cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:42.837751 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-c597c6c3-f250-4318-8214-c7f7cbe6d656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:42.904728 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 556/1119] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:15:42 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:42.918449 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1825e1-4707-4743-a6a5-c5ec33bf9df4 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:42.918449 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1825e1-4707-4743-a6a5-c5ec33bf9df4 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:42.918676 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1825e1-4707-4743-a6a5-c5ec33bf9df4 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:42.920023 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 564/1120] 10.222.0.58 () {54 vars in 964 bytes} [Tue Aug 23 22:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:42.924915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747533d8-03a0-4cb5-9a29-ac514d745cd0 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:42.925257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747533d8-03a0-4cb5-9a29-ac514d745cd0 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:42.925537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747533d8-03a0-4cb5-9a29-ac514d745cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:42.945683 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-747533d8-03a0-4cb5-9a29-ac514d745cd0 None None] MFA Rules not processed for user `60819c30ec7c42d1a1891e7ce07f8473`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:42.946875 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-747533d8-03a0-4cb5-9a29-ac514d745cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:42.990167 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:43.000814 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 557/1121] 10.222.0.58 () {58 vars in 1061 bytes} [Tue Aug 23 22:15:42 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:43.009251 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1825e1-4707-4743-a6a5-c5ec33bf9df4 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:43.019674 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1825e1-4707-4743-a6a5-c5ec33bf9df4 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:43.023116 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfb97a-c24b-4e0b-b630-bb90e7aaf3c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60819c30ec7c42d1a1891e7ce07f8473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:43.023697 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb97a-c24b-4e0b-b630-bb90e7aaf3c3 service cinder] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.024036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb97a-c24b-4e0b-b630-bb90e7aaf3c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.024312 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb97a-c24b-4e0b-b630-bb90e7aaf3c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.032355 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfb97a-c24b-4e0b-b630-bb90e7aaf3c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:43.033775 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfb97a-c24b-4e0b-b630-bb90e7aaf3c3 service cinder] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:43.042994 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 565/1122] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:43 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:15:43.081194 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe704730-5b5c-4126-9bb8-9ef3ca293045 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.081481 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe704730-5b5c-4126-9bb8-9ef3ca293045 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.081751 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe704730-5b5c-4126-9bb8-9ef3ca293045 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.083052 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 558/1123] 10.222.0.58 () {52 vars in 830 bytes} [Tue Aug 23 22:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:15:43.086569 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfb97a-c24b-4e0b-b630-bb90e7aaf3c3 service cinder] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:43.154751 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfb97a-c24b-4e0b-b630-bb90e7aaf3c3 service cinder] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:43.159325 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:43.159977 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.160261 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.160535 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] PATH_INFO: `/v3/users/f5608f3e79aa4f199b11cfe9f1b821cb` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.162865 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5608f3e79aa4f199b11cfe9f1b821cb)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:43.163242 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: WARNING py.warnings [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:15:43.163242 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: warnings.warn(msg) Aug 23 22:15:43.163242 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: Aug 23 22:15:43.164571 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:43.231415 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5608f3e79aa4f199b11cfe9f1b821cb'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:15:43.245777 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5608f3e79aa4f199b11cfe9f1b821cb'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:15:43.246592 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5608f3e79aa4f199b11cfe9f1b821cb'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:15:43.247221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5608f3e79aa4f199b11cfe9f1b821cb'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:15:43.257553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5608f3e79aa4f199b11cfe9f1b821cb'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:15:43.290231 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 566/1124] 10.222.0.58 () {58 vars in 1224 bytes} [Tue Aug 23 22:15:43 2022] DELETE /identity/v3/users/f5608f3e79aa4f199b11cfe9f1b821cb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:15:43.294793 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb8cae-c5d3-4b6e-a45c-511f91763288 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.295080 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb8cae-c5d3-4b6e-a45c-511f91763288 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.295356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb8cae-c5d3-4b6e-a45c-511f91763288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.314700 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-6edb8cae-c5d3-4b6e-a45c-511f91763288 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:15:43.315911 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-6edb8cae-c5d3-4b6e-a45c-511f91763288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:43.375303 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 559/1125] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:15:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:15:43.386428 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:43.387927 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:43.393263 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:43.451291 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa59549-9ba0-48c9-8348-ea2bed4933a7 admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:43.458849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981dd44-f122-4d4b-8e4f-cd29dcf06122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:43.459470 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981dd44-f122-4d4b-8e4f-cd29dcf06122 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.459754 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981dd44-f122-4d4b-8e4f-cd29dcf06122 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.460068 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981dd44-f122-4d4b-8e4f-cd29dcf06122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.473897 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981dd44-f122-4d4b-8e4f-cd29dcf06122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:43.475530 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981dd44-f122-4d4b-8e4f-cd29dcf06122 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:43.492455 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 567/1126] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:15:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:15:43.894996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb8cae-c5d3-4b6e-a45c-511f91763288 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:15:43.896592 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-6edb8cae-c5d3-4b6e-a45c-511f91763288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:15:43.908541 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb8cae-c5d3-4b6e-a45c-511f91763288 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:15:43.914070 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:15:43.914677 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:15:43.914959 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:15:43.915230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] PATH_INFO: `/v3/projects/2806744ff61c4d148c527fd160c2d85d` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:15:43.916390 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2806744ff61c4d148c527fd160c2d85d)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:15:43.917411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: WARNING py.warnings [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:15:43.917411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: warnings.warn(msg) Aug 23 22:15:43.917411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: Aug 23 22:15:43.918614 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:15:43.981791 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2806744ff61c4d148c527fd160c2d85d', 'request_id': 'req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:15:43.995278 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2806744ff61c4d148c527fd160c2d85d', 'request_id': 'req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:15:44.005334 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2806744ff61c4d148c527fd160c2d85d', 'request_id': 'req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:15:44.016414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] The token cache is being invalidate because project 2806744ff61c4d148c527fd160c2d85d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88405) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:15:44.016667 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:15:44.017386 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-0c462cb8-e968-4e01-a5d1-0e3dd7b9d2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:15:44.019149 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 560/1127] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Aug 23 22:15:43 2022] DELETE /identity/v3/projects/2806744ff61c4d148c527fd160c2d85d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:15:53.482475 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=25 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:15:54.013317 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:08.422356 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9febb0-aaad-45e7-b9a6-b81f7c357e39 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:08.422951 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9febb0-aaad-45e7-b9a6-b81f7c357e39 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:08.422951 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9febb0-aaad-45e7-b9a6-b81f7c357e39 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:08.424266 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 568/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:08.429628 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425f507-79da-42f1-8f19-5b350d905428 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:08.430057 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425f507-79da-42f1-8f19-5b350d905428 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:08.430157 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425f507-79da-42f1-8f19-5b350d905428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:08.505310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-e425f507-79da-42f1-8f19-5b350d905428 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:08.506437 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-e425f507-79da-42f1-8f19-5b350d905428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:08.606171 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 561/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:17:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:17:08.763644 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9febb0-aaad-45e7-b9a6-b81f7c357e39 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:08.765476 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-8e9febb0-aaad-45e7-b9a6-b81f7c357e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:08.855649 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9febb0-aaad-45e7-b9a6-b81f7c357e39 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:08.860640 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed03600-d282-4cc5-bd9f-d35420074673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:08.861250 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed03600-d282-4cc5-bd9f-d35420074673 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:08.861531 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed03600-d282-4cc5-bd9f-d35420074673 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:08.861799 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed03600-d282-4cc5-bd9f-d35420074673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:08.870078 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed03600-d282-4cc5-bd9f-d35420074673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:08.871654 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed03600-d282-4cc5-bd9f-d35420074673 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:08.881029 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 569/1130] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:09.732295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922b510-b0a0-49c8-a247-0884b68ead3e None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:09.732879 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922b510-b0a0-49c8-a247-0884b68ead3e None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:09.732879 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922b510-b0a0-49c8-a247-0884b68ead3e None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:09.734168 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 562/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:09.739177 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7c8bd-6262-4b3a-9a3e-ff50782cbb6a None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:09.739578 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7c8bd-6262-4b3a-9a3e-ff50782cbb6a None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:09.739725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7c8bd-6262-4b3a-9a3e-ff50782cbb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:09.759588 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-9ba7c8bd-6262-4b3a-9a3e-ff50782cbb6a None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:09.760835 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-9ba7c8bd-6262-4b3a-9a3e-ff50782cbb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:09.768757 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 570/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:17:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:09.928248 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922b510-b0a0-49c8-a247-0884b68ead3e None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:09.942935 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922b510-b0a0-49c8-a247-0884b68ead3e None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:09.948629 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7ca38-5b80-415c-ba3c-9733071ce071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:09.949228 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7ca38-5b80-415c-ba3c-9733071ce071 service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:09.949504 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7ca38-5b80-415c-ba3c-9733071ce071 service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:09.949773 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7ca38-5b80-415c-ba3c-9733071ce071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:09.958897 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7ca38-5b80-415c-ba3c-9733071ce071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:09.960607 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7ca38-5b80-415c-ba3c-9733071ce071 service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:09.970894 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 563/1133] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:13.478445 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d32a8-80dc-4a75-a008-2c7d3792d617 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:13.479310 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d32a8-80dc-4a75-a008-2c7d3792d617 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:13.479310 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d32a8-80dc-4a75-a008-2c7d3792d617 None None] PATH_INFO: `/v3` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:13.480589 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 571/1134] 10.222.0.17 () {54 vars in 925 bytes} [Tue Aug 23 22:17:13 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 22:17:13.486720 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25905360-0e49-4810-bc2d-e4baf9a6fef2 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:13.487162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25905360-0e49-4810-bc2d-e4baf9a6fef2 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:13.487260 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25905360-0e49-4810-bc2d-e4baf9a6fef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:13.518593 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-25905360-0e49-4810-bc2d-e4baf9a6fef2 None None] MFA Rules not processed for user `7a55d53b8c1a4dffa00b9114d1df498a`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:13.519779 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-25905360-0e49-4810-bc2d-e4baf9a6fef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:13.577581 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=100 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:13.588289 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 564/1135] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Aug 23 22:17:13 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:19.754735 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=42 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:21.277399 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefce749-8266-46aa-9434-59be1d7314b4 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:21.278069 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefce749-8266-46aa-9434-59be1d7314b4 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:21.278069 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefce749-8266-46aa-9434-59be1d7314b4 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:21.279324 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 572/1136] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:17:21.284520 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2e5dd-9ee4-4fb3-a5bb-e0edcd75245f None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:21.284977 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2e5dd-9ee4-4fb3-a5bb-e0edcd75245f None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:21.285088 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2e5dd-9ee4-4fb3-a5bb-e0edcd75245f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:21.307489 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-aed2e5dd-9ee4-4fb3-a5bb-e0edcd75245f None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:21.308757 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-aed2e5dd-9ee4-4fb3-a5bb-e0edcd75245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:21.317119 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 565/1137] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:17:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:21.479671 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefce749-8266-46aa-9434-59be1d7314b4 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:21.499082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefce749-8266-46aa-9434-59be1d7314b4 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:21.504316 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7ae71-6fbf-4117-8391-3cfb0104b6f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:21.504916 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7ae71-6fbf-4117-8391-3cfb0104b6f6 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:21.505197 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7ae71-6fbf-4117-8391-3cfb0104b6f6 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:21.505465 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7ae71-6fbf-4117-8391-3cfb0104b6f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:21.514858 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7ae71-6fbf-4117-8391-3cfb0104b6f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:21.516495 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7ae71-6fbf-4117-8391-3cfb0104b6f6 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:21.526920 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 573/1138] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:22.368609 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1c3bf-5d04-4724-a549-e46e3fdd95cd None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:22.369177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1c3bf-5d04-4724-a549-e46e3fdd95cd None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:22.369177 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1c3bf-5d04-4724-a549-e46e3fdd95cd None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:22.370482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 566/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 22:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:22.375733 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6612dfd-437a-4c2f-9663-715bb06a592a None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:22.376224 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6612dfd-437a-4c2f-9663-715bb06a592a None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:22.376346 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6612dfd-437a-4c2f-9663-715bb06a592a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:22.400967 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-b6612dfd-437a-4c2f-9663-715bb06a592a None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:22.402087 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-b6612dfd-437a-4c2f-9663-715bb06a592a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:22.410458 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 574/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 22:17:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:17:22.573243 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1c3bf-5d04-4724-a549-e46e3fdd95cd None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:22.587208 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1c3bf-5d04-4724-a549-e46e3fdd95cd None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:22.588328 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb310c-c431-46e1-a2c1-6fe1a6fbf6f5 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:22.588617 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb310c-c431-46e1-a2c1-6fe1a6fbf6f5 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:22.588887 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb310c-c431-46e1-a2c1-6fe1a6fbf6f5 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:22.590579 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 575/1141] 10.222.0.58 () {54 vars in 961 bytes} [Tue Aug 23 22:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:17:22.592300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827bfa-4dc1-4169-88c9-92ce2edc439d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:22.592896 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827bfa-4dc1-4169-88c9-92ce2edc439d service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:22.593169 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827bfa-4dc1-4169-88c9-92ce2edc439d service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:22.593436 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827bfa-4dc1-4169-88c9-92ce2edc439d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:22.595548 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04ae54-75a6-4bd3-b9d5-e8b7eb3cd8de None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:22.595845 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04ae54-75a6-4bd3-b9d5-e8b7eb3cd8de None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:22.596126 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04ae54-75a6-4bd3-b9d5-e8b7eb3cd8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:22.603083 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1827bfa-4dc1-4169-88c9-92ce2edc439d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:22.605819 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1827bfa-4dc1-4169-88c9-92ce2edc439d service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:22.615610 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-bd04ae54-75a6-4bd3-b9d5-e8b7eb3cd8de None None] MFA Rules not processed for user `7a55d53b8c1a4dffa00b9114d1df498a`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:22.615783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 567/1142] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:22.617501 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-bd04ae54-75a6-4bd3-b9d5-e8b7eb3cd8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:22.626878 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 576/1143] 10.222.0.58 () {58 vars in 1058 bytes} [Tue Aug 23 22:17:22 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:17:22.635525 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827bfa-4dc1-4169-88c9-92ce2edc439d service nova] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:22.647460 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827bfa-4dc1-4169-88c9-92ce2edc439d service nova] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:22.654647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de9b5c-bc84-441d-ad8a-5901ed7a1863 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55d53b8c1a4dffa00b9114d1df498a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:22.655294 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9b5c-bc84-441d-ad8a-5901ed7a1863 service placement] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:22.655574 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9b5c-bc84-441d-ad8a-5901ed7a1863 service placement] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:22.655867 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9b5c-bc84-441d-ad8a-5901ed7a1863 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:22.666087 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de9b5c-bc84-441d-ad8a-5901ed7a1863 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:22.667724 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de9b5c-bc84-441d-ad8a-5901ed7a1863 service placement] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:22.678846 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 568/1144] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:22 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:27.019862 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfd935-ef3f-47c6-be2e-97d27103f4f9 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:27.020422 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfd935-ef3f-47c6-be2e-97d27103f4f9 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:27.020422 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfd935-ef3f-47c6-be2e-97d27103f4f9 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:27.021761 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 577/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:27.027915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd4311-c2d2-45be-a211-7c2f4d76f867 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:27.028387 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd4311-c2d2-45be-a211-7c2f4d76f867 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:27.028489 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd4311-c2d2-45be-a211-7c2f4d76f867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:27.048281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-a8bd4311-c2d2-45be-a211-7c2f4d76f867 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:27.049490 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-a8bd4311-c2d2-45be-a211-7c2f4d76f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:27.057510 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 569/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:27.418079 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfd935-ef3f-47c6-be2e-97d27103f4f9 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:27.419795 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-90cfd935-ef3f-47c6-be2e-97d27103f4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:27.484869 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfd935-ef3f-47c6-be2e-97d27103f4f9 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:27.488494 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf52074-e1e2-4bd5-8d4a-137f0f612ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:27.489153 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf52074-e1e2-4bd5-8d4a-137f0f612ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:27.489315 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf52074-e1e2-4bd5-8d4a-137f0f612ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:27.489589 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf52074-e1e2-4bd5-8d4a-137f0f612ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:27.500440 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf52074-e1e2-4bd5-8d4a-137f0f612ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:27.501894 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf52074-e1e2-4bd5-8d4a-137f0f612ad8 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:27.512342 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 578/1147] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:29.725717 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae5648-5b14-43a6-850d-1506741611c8 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:29.726319 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae5648-5b14-43a6-850d-1506741611c8 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:29.726319 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae5648-5b14-43a6-850d-1506741611c8 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:29.727793 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 570/1148] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:29.733474 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598700b-5378-40c9-8ea4-3ad9c5f3c075 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:29.733901 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598700b-5378-40c9-8ea4-3ad9c5f3c075 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:29.734055 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598700b-5378-40c9-8ea4-3ad9c5f3c075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:29.753334 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-3598700b-5378-40c9-8ea4-3ad9c5f3c075 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:29.754363 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-3598700b-5378-40c9-8ea4-3ad9c5f3c075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:29.763378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 579/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:30.121008 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae5648-5b14-43a6-850d-1506741611c8 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:30.132132 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae5648-5b14-43a6-850d-1506741611c8 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:30.136055 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acb22b-2a69-4566-8621-096f84cc8f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:30.136657 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acb22b-2a69-4566-8621-096f84cc8f6a service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:30.136933 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acb22b-2a69-4566-8621-096f84cc8f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:30.137199 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acb22b-2a69-4566-8621-096f84cc8f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:30.152546 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acb22b-2a69-4566-8621-096f84cc8f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:30.153996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acb22b-2a69-4566-8621-096f84cc8f6a service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:30.164841 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 571/1150] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:17:34.410907 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45cde8-ecd8-4c1d-bf8e-d523a39305d7 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:34.411589 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45cde8-ecd8-4c1d-bf8e-d523a39305d7 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:34.411589 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45cde8-ecd8-4c1d-bf8e-d523a39305d7 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:34.413410 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 580/1151] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:34.420309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71a8f6-668f-4697-b53a-b25de7234b7f None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:34.421146 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71a8f6-668f-4697-b53a-b25de7234b7f None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:34.421146 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71a8f6-668f-4697-b53a-b25de7234b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:34.440739 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-0b71a8f6-668f-4697-b53a-b25de7234b7f None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:34.441940 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-0b71a8f6-668f-4697-b53a-b25de7234b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:34.450315 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 572/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:17:35.028365 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45cde8-ecd8-4c1d-bf8e-d523a39305d7 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:35.030093 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-fd45cde8-ecd8-4c1d-bf8e-d523a39305d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:35.088976 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45cde8-ecd8-4c1d-bf8e-d523a39305d7 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:35.092494 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86f099-0758-4d49-8f4b-77f8feadfb2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60819c30ec7c42d1a1891e7ce07f8473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:35.093105 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86f099-0758-4d49-8f4b-77f8feadfb2e service cinder] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:35.093386 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86f099-0758-4d49-8f4b-77f8feadfb2e service cinder] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:35.093660 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86f099-0758-4d49-8f4b-77f8feadfb2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:35.102882 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86f099-0758-4d49-8f4b-77f8feadfb2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:35.104624 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86f099-0758-4d49-8f4b-77f8feadfb2e service cinder] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:35.114333 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 581/1153] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:37.374995 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827672-d4bf-4f96-a50b-e28fe952d280 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:37.375653 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827672-d4bf-4f96-a50b-e28fe952d280 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:37.375653 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827672-d4bf-4f96-a50b-e28fe952d280 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:37.376878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 573/1154] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 22:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:17:37.382085 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b328d8-0806-4130-823e-8ed8f539ba40 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:37.383611 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b328d8-0806-4130-823e-8ed8f539ba40 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:37.383926 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b328d8-0806-4130-823e-8ed8f539ba40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:37.403856 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-28b328d8-0806-4130-823e-8ed8f539ba40 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:17:37.405055 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-28b328d8-0806-4130-823e-8ed8f539ba40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:37.412875 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 582/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 22:17:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:17:37.983017 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e827672-d4bf-4f96-a50b-e28fe952d280 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:17:37.984713 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-3e827672-d4bf-4f96-a50b-e28fe952d280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:17:37.997783 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e827672-d4bf-4f96-a50b-e28fe952d280 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:17:38.001271 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c410d-0186-497d-813e-3fba6300c8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60819c30ec7c42d1a1891e7ce07f8473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:17:38.001859 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c410d-0186-497d-813e-3fba6300c8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:17:38.002145 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c410d-0186-497d-813e-3fba6300c8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:17:38.002417 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c410d-0186-497d-813e-3fba6300c8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:17:38.011735 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c410d-0186-497d-813e-3fba6300c8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:17:38.013191 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c410d-0186-497d-813e-3fba6300c8d5 service cinder] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:17:38.022383 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 574/1156] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:17:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:17:47.398326 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=70 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:17:48.018394 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=33 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:51.312344 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185ff87-b768-4b95-89e8-a6bb5db3ebf9 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.312937 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185ff87-b768-4b95-89e8-a6bb5db3ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.312937 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185ff87-b768-4b95-89e8-a6bb5db3ebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.320549 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79ebf8-afad-4749-8d8d-38bb69c7760b None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.321224 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79ebf8-afad-4749-8d8d-38bb69c7760b None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.321548 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79ebf8-afad-4749-8d8d-38bb69c7760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.332716 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-1185ff87-b768-4b95-89e8-a6bb5db3ebf9 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:51.333982 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-1185ff87-b768-4b95-89e8-a6bb5db3ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:51.341689 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-8c79ebf8-afad-4749-8d8d-38bb69c7760b None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:51.341989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 583/1157] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:18:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:51.342938 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-8c79ebf8-afad-4749-8d8d-38bb69c7760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:51.350399 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efede3ad-1193-443b-a353-25884a7ac673 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.350687 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efede3ad-1193-443b-a353-25884a7ac673 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.350985 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efede3ad-1193-443b-a353-25884a7ac673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.351438 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 575/1158] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:18:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:18:51.360100 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca6cd-3ceb-4ad4-967d-402e0f960b23 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.360387 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca6cd-3ceb-4ad4-967d-402e0f960b23 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.360660 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca6cd-3ceb-4ad4-967d-402e0f960b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.372192 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-efede3ad-1193-443b-a353-25884a7ac673 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:51.373423 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-efede3ad-1193-443b-a353-25884a7ac673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:51.380635 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-7f6ca6cd-3ceb-4ad4-967d-402e0f960b23 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:51.381574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 584/1159] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:18:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:18:51.381801 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-7f6ca6cd-3ceb-4ad4-967d-402e0f960b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:51.386117 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efede3ad-1193-443b-a353-25884a7ac673 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.389870 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 576/1160] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:18:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:18:51.394088 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ca6cd-3ceb-4ad4-967d-402e0f960b23 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.395543 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efede3ad-1193-443b-a353-25884a7ac673 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.400432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22970b-eb6f-4832-8e26-c43f5ae36e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.401029 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22970b-eb6f-4832-8e26-c43f5ae36e08 admin admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.401308 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22970b-eb6f-4832-8e26-c43f5ae36e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.401582 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22970b-eb6f-4832-8e26-c43f5ae36e08 admin admin] PATH_INFO: `/v3/domains` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.402225 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22970b-eb6f-4832-8e26-c43f5ae36e08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88404) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:18:51.402526 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22970b-eb6f-4832-8e26-c43f5ae36e08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.403026 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ca6cd-3ceb-4ad4-967d-402e0f960b23 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.403537 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: WARNING py.warnings [None req-ea22970b-eb6f-4832-8e26-c43f5ae36e08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:18:51.403537 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: warnings.warn(msg) Aug 23 22:18:51.403537 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: Aug 23 22:18:51.404491 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22970b-eb6f-4832-8e26-c43f5ae36e08 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.407598 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdae44-0b63-4b2d-a2c4-8428f8a4a82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.408208 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdae44-0b63-4b2d-a2c4-8428f8a4a82a admin admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.408490 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdae44-0b63-4b2d-a2c4-8428f8a4a82a admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.408760 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdae44-0b63-4b2d-a2c4-8428f8a4a82a admin admin] PATH_INFO: `/v3/domains` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.409389 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdae44-0b63-4b2d-a2c4-8428f8a4a82a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88405) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 22:18:51.409693 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdae44-0b63-4b2d-a2c4-8428f8a4a82a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.411315 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdae44-0b63-4b2d-a2c4-8428f8a4a82a admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.417148 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 585/1161] 10.222.0.58 () {58 vars in 1153 bytes} [Tue Aug 23 22:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:18:51.424037 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 577/1162] 10.222.0.58 () {58 vars in 1153 bytes} [Tue Aug 23 22:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 22:18:51.424849 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22970b-eb6f-4832-8e26-c43f5ae36e08 admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.432454 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdae44-0b63-4b2d-a2c4-8428f8a4a82a admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.435608 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22970b-eb6f-4832-8e26-c43f5ae36e08 admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.440223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4d261-9e25-4a58-898a-c5473e890105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.440820 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4d261-9e25-4a58-898a-c5473e890105 admin admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.441104 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4d261-9e25-4a58-898a-c5473e890105 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.441378 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4d261-9e25-4a58-898a-c5473e890105 admin admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.441998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4d261-9e25-4a58-898a-c5473e890105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.442311 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdae44-0b63-4b2d-a2c4-8428f8a4a82a admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.443946 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4d261-9e25-4a58-898a-c5473e890105 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.447539 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ca4f9-4d9a-49df-a9dd-861305408694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.448171 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ca4f9-4d9a-49df-a9dd-861305408694 admin admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.448452 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ca4f9-4d9a-49df-a9dd-861305408694 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.448731 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ca4f9-4d9a-49df-a9dd-861305408694 admin admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.449348 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ca4f9-4d9a-49df-a9dd-861305408694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.450385 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: WARNING py.warnings [None req-9a1ca4f9-4d9a-49df-a9dd-861305408694 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:18:51.450385 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: warnings.warn(msg) Aug 23 22:18:51.450385 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: Aug 23 22:18:51.451865 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ca4f9-4d9a-49df-a9dd-861305408694 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.484070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 586/1163] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Aug 23 22:18:51 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:18:51.488133 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4d261-9e25-4a58-898a-c5473e890105 admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.497309 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 578/1164] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Aug 23 22:18:51 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:18:51.498300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ca4f9-4d9a-49df-a9dd-861305408694 admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.553387 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4d261-9e25-4a58-898a-c5473e890105 admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.558644 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260439f5-0031-46a4-bc48-c0631c935a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.559255 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260439f5-0031-46a4-bc48-c0631c935a96 admin admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.559536 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260439f5-0031-46a4-bc48-c0631c935a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.559811 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260439f5-0031-46a4-bc48-c0631c935a96 admin admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.560029 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ca4f9-4d9a-49df-a9dd-861305408694 admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.560454 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260439f5-0031-46a4-bc48-c0631c935a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.561463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: WARNING py.warnings [None req-260439f5-0031-46a4-bc48-c0631c935a96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:18:51.561463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: warnings.warn(msg) Aug 23 22:18:51.561463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: Aug 23 22:18:51.562751 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260439f5-0031-46a4-bc48-c0631c935a96 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.564869 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a1cda-f2be-405e-aa6f-7d4463003d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.565472 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a1cda-f2be-405e-aa6f-7d4463003d0f admin admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.565751 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a1cda-f2be-405e-aa6f-7d4463003d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.566024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a1cda-f2be-405e-aa6f-7d4463003d0f admin admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.566638 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a1cda-f2be-405e-aa6f-7d4463003d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.568593 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a1cda-f2be-405e-aa6f-7d4463003d0f admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.590998 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 587/1165] 10.222.0.58 () {60 vars in 1144 bytes} [Tue Aug 23 22:18:51 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:18:51.592045 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260439f5-0031-46a4-bc48-c0631c935a96 admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.597376 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 579/1166] 10.222.0.58 () {60 vars in 1144 bytes} [Tue Aug 23 22:18:51 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:18:51.598925 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a1cda-f2be-405e-aa6f-7d4463003d0f admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.601738 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260439f5-0031-46a4-bc48-c0631c935a96 admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.607432 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ab5d-a2fc-4a38-b16a-c2a8fe0ffcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.608052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ab5d-a2fc-4a38-b16a-c2a8fe0ffcee admin admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.608336 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ab5d-a2fc-4a38-b16a-c2a8fe0ffcee admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.608610 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ab5d-a2fc-4a38-b16a-c2a8fe0ffcee admin admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.609245 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918ab5d-a2fc-4a38-b16a-c2a8fe0ffcee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.609685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a1cda-f2be-405e-aa6f-7d4463003d0f admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.610840 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918ab5d-a2fc-4a38-b16a-c2a8fe0ffcee admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.614285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e45e81-d2fa-4094-8224-55c8eb5dd39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.614878 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e45e81-d2fa-4094-8224-55c8eb5dd39e admin admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.615160 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e45e81-d2fa-4094-8224-55c8eb5dd39e admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.615436 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e45e81-d2fa-4094-8224-55c8eb5dd39e admin admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.616111 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e45e81-d2fa-4094-8224-55c8eb5dd39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.617917 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e45e81-d2fa-4094-8224-55c8eb5dd39e admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.623247 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 588/1167] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Aug 23 22:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:18:51.627455 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ab5d-a2fc-4a38-b16a-c2a8fe0ffcee admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.632592 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 580/1168] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Aug 23 22:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:18:51.634233 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e45e81-d2fa-4094-8224-55c8eb5dd39e admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.638937 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ab5d-a2fc-4a38-b16a-c2a8fe0ffcee admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.643642 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04926790-96d7-49f5-a367-708965c7d396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.644275 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04926790-96d7-49f5-a367-708965c7d396 admin admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.644559 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04926790-96d7-49f5-a367-708965c7d396 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.644706 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e45e81-d2fa-4094-8224-55c8eb5dd39e admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.644837 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04926790-96d7-49f5-a367-708965c7d396 admin admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.645474 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04926790-96d7-49f5-a367-708965c7d396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.647074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04926790-96d7-49f5-a367-708965c7d396 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.650091 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c49c0-f403-4b8a-a8b8-8c76ce6b7b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.650679 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c49c0-f403-4b8a-a8b8-8c76ce6b7b7a admin admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.650960 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c49c0-f403-4b8a-a8b8-8c76ce6b7b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.651230 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c49c0-f403-4b8a-a8b8-8c76ce6b7b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.651877 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c49c0-f403-4b8a-a8b8-8c76ce6b7b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.653488 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c49c0-f403-4b8a-a8b8-8c76ce6b7b7a admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.658929 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 589/1169] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Aug 23 22:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 22:18:51.662802 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04926790-96d7-49f5-a367-708965c7d396 admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.667175 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 581/1170] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Aug 23 22:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:18:51.668394 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c49c0-f403-4b8a-a8b8-8c76ce6b7b7a admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.673067 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04926790-96d7-49f5-a367-708965c7d396 admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.677638 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ae839-4deb-4059-9cbf-d868c8a2770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.677979 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c49c0-f403-4b8a-a8b8-8c76ce6b7b7a admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.678286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ae839-4deb-4059-9cbf-d868c8a2770e admin admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.678575 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ae839-4deb-4059-9cbf-d868c8a2770e admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.678851 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ae839-4deb-4059-9cbf-d868c8a2770e admin admin] PATH_INFO: `/v3/projects/4e06ade31ecd457bbd3388109b667188/users/93cd01203fcf457291cc4146432580c3/roles/57d5f513f8fd4d7dbd1ef0ecc319892e` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.683415 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fbc4a-f5f7-454c-bedf-17e10f2e888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.684111 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fbc4a-f5f7-454c-bedf-17e10f2e888f admin admin] REQUEST_METHOD: `PUT` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.684388 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fbc4a-f5f7-454c-bedf-17e10f2e888f admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.684662 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fbc4a-f5f7-454c-bedf-17e10f2e888f admin admin] PATH_INFO: `/v3/projects/9bb6dd312829496eae2a76fbf0f3b55c/users/2845f6aa2ede4873b12c1e4a703a0ddd/roles/57d5f513f8fd4d7dbd1ef0ecc319892e` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.694556 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ae839-4deb-4059-9cbf-d868c8a2770e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e06ade31ecd457bbd3388109b667188, user_id=93cd01203fcf457291cc4146432580c3, role_id=57d5f513f8fd4d7dbd1ef0ecc319892e)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.698128 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ae839-4deb-4059-9cbf-d868c8a2770e admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.700225 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fbc4a-f5f7-454c-bedf-17e10f2e888f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb6dd312829496eae2a76fbf0f3b55c, user_id=2845f6aa2ede4873b12c1e4a703a0ddd, role_id=57d5f513f8fd4d7dbd1ef0ecc319892e)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.701255 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: WARNING py.warnings [None req-2d9fbc4a-f5f7-454c-bedf-17e10f2e888f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:18:51.701255 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: warnings.warn(msg) Aug 23 22:18:51.701255 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: Aug 23 22:18:51.703211 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fbc4a-f5f7-454c-bedf-17e10f2e888f admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.713370 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 590/1171] 10.222.0.58 () {60 vars in 1483 bytes} [Tue Aug 23 22:18:51 2022] PUT /identity/v3/projects/4e06ade31ecd457bbd3388109b667188/users/93cd01203fcf457291cc4146432580c3/roles/57d5f513f8fd4d7dbd1ef0ecc319892e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:18:51.718574 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5538e61-6abc-4911-a771-294b7ad7715e None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.718869 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5538e61-6abc-4911-a771-294b7ad7715e None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.719148 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5538e61-6abc-4911-a771-294b7ad7715e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.719961 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 582/1172] 10.222.0.58 () {60 vars in 1483 bytes} [Tue Aug 23 22:18:51 2022] PUT /identity/v3/projects/9bb6dd312829496eae2a76fbf0f3b55c/users/2845f6aa2ede4873b12c1e4a703a0ddd/roles/57d5f513f8fd4d7dbd1ef0ecc319892e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:18:51.724723 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ff0a3-6b0f-42a2-b643-80e33a08c688 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.725010 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ff0a3-6b0f-42a2-b643-80e33a08c688 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.725289 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ff0a3-6b0f-42a2-b643-80e33a08c688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.738273 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-a5538e61-6abc-4911-a771-294b7ad7715e None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:51.739448 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-a5538e61-6abc-4911-a771-294b7ad7715e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:51.745199 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-697ff0a3-6b0f-42a2-b643-80e33a08c688 None None] MFA Rules not processed for user `88d08af5e2704454a689607c83d9c037`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:51.746393 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-697ff0a3-6b0f-42a2-b643-80e33a08c688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:51.782070 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:51.790197 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:51.801897 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 591/1173] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:18:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:51.810702 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 583/1174] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:18:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:18:51.812827 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5538e61-6abc-4911-a771-294b7ad7715e None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.819969 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ff0a3-6b0f-42a2-b643-80e33a08c688 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:51.871554 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5538e61-6abc-4911-a771-294b7ad7715e None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.875239 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ed09e-ed56-4f81-9ee9-f95f566731b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.875874 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ed09e-ed56-4f81-9ee9-f95f566731b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.876158 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ed09e-ed56-4f81-9ee9-f95f566731b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.876433 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ed09e-ed56-4f81-9ee9-f95f566731b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.878143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ff0a3-6b0f-42a2-b643-80e33a08c688 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:51.881755 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35404dcb-a561-43ee-905d-7d825a0f5bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:51.882361 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35404dcb-a561-43ee-905d-7d825a0f5bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:51.882641 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35404dcb-a561-43ee-905d-7d825a0f5bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:51.882915 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35404dcb-a561-43ee-905d-7d825a0f5bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:51.886465 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ed09e-ed56-4f81-9ee9-f95f566731b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.887928 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ed09e-ed56-4f81-9ee9-f95f566731b8 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.892660 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35404dcb-a561-43ee-905d-7d825a0f5bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:51.894192 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35404dcb-a561-43ee-905d-7d825a0f5bd6 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:51.897552 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 592/1175] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:18:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:18:51.904216 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 584/1176] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:18:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:18:58.210627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29b571-2528-4328-9261-92e539a37898 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.212419 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29b571-2528-4328-9261-92e539a37898 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.214529 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29b571-2528-4328-9261-92e539a37898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.277259 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-3e29b571-2528-4328-9261-92e539a37898 None None] MFA Rules not processed for user `2845f6aa2ede4873b12c1e4a703a0ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:58.278681 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-3e29b571-2528-4328-9261-92e539a37898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:58.394455 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fe789-5e95-4774-b8b0-59b15c6707c0 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.394989 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fe789-5e95-4774-b8b0-59b15c6707c0 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.396152 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fe789-5e95-4774-b8b0-59b15c6707c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.401466 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 593/1177] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:18:58 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:18:58.405398 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29b571-2528-4328-9261-92e539a37898 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:58.418026 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29b571-2528-4328-9261-92e539a37898 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:58.423978 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8df77-5342-4460-baeb-dda183b23331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:58.425213 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8df77-5342-4460-baeb-dda183b23331 admin admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.425343 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8df77-5342-4460-baeb-dda183b23331 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.425618 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8df77-5342-4460-baeb-dda183b23331 admin admin] PATH_INFO: `/v3/projects` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.426451 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8df77-5342-4460-baeb-dda183b23331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:58.428727 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8df77-5342-4460-baeb-dda183b23331 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:58.439724 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-150fe789-5e95-4774-b8b0-59b15c6707c0 None None] MFA Rules not processed for user `93cd01203fcf457291cc4146432580c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:18:58.441330 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-150fe789-5e95-4774-b8b0-59b15c6707c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:18:58.468135 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 594/1178] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Aug 23 22:18:58 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:18:58.469232 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8df77-5342-4460-baeb-dda183b23331 admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:58.549157 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:58.553896 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 585/1179] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:18:58 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:18:58.556822 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8df77-5342-4460-baeb-dda183b23331 admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:58.560248 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fe789-5e95-4774-b8b0-59b15c6707c0 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:58.565955 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad0446-daac-479f-abdd-aed262e43fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:58.566488 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad0446-daac-479f-abdd-aed262e43fcc admin admin] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.566767 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad0446-daac-479f-abdd-aed262e43fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.567146 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad0446-daac-479f-abdd-aed262e43fcc admin admin] PATH_INFO: `/v3/users` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.567652 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad0446-daac-479f-abdd-aed262e43fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:58.569627 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad0446-daac-479f-abdd-aed262e43fcc admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:58.574220 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fe789-5e95-4774-b8b0-59b15c6707c0 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:58.578449 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f598-86c4-4bca-b370-5424e7c6f15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:58.579169 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f598-86c4-4bca-b370-5424e7c6f15a admin admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.579537 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f598-86c4-4bca-b370-5424e7c6f15a admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.579815 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811f598-86c4-4bca-b370-5424e7c6f15a admin admin] PATH_INFO: `/v3/projects` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.580591 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811f598-86c4-4bca-b370-5424e7c6f15a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:58.582530 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811f598-86c4-4bca-b370-5424e7c6f15a admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:58.619778 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 595/1180] 10.222.0.58 () {60 vars in 1144 bytes} [Tue Aug 23 22:18:58 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:18:58.620981 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad0446-daac-479f-abdd-aed262e43fcc admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:58.631188 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad0446-daac-479f-abdd-aed262e43fcc admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:58.634885 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 586/1181] 10.222.0.58 () {60 vars in 1153 bytes} [Tue Aug 23 22:18:58 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 22:18:58.635891 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdb5d8-0cce-462a-b6f8-80b9da0790cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:58.636497 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdb5d8-0cce-462a-b6f8-80b9da0790cd admin admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.636773 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdb5d8-0cce-462a-b6f8-80b9da0790cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.637042 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdb5d8-0cce-462a-b6f8-80b9da0790cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.637678 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdb5d8-0cce-462a-b6f8-80b9da0790cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:58.639075 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f598-86c4-4bca-b370-5424e7c6f15a admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:58.639302 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdb5d8-0cce-462a-b6f8-80b9da0790cd admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:58.661221 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 596/1182] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Aug 23 22:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:18:58.668982 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdb5d8-0cce-462a-b6f8-80b9da0790cd admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:58.685485 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdb5d8-0cce-462a-b6f8-80b9da0790cd admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:58.723526 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:58.728906 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811f598-86c4-4bca-b370-5424e7c6f15a admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:58.745869 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a687d91-5995-4b3e-b1b7-dc52d9311fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:58.746610 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687d91-5995-4b3e-b1b7-dc52d9311fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.746958 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687d91-5995-4b3e-b1b7-dc52d9311fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.747534 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687d91-5995-4b3e-b1b7-dc52d9311fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.748240 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a687d91-5995-4b3e-b1b7-dc52d9311fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:58.750365 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a687d91-5995-4b3e-b1b7-dc52d9311fc8 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:58.774374 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945c748-87bf-47f9-bdc4-22dfc1653942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:58.775087 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945c748-87bf-47f9-bdc4-22dfc1653942 admin admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.775376 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945c748-87bf-47f9-bdc4-22dfc1653942 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.775659 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945c748-87bf-47f9-bdc4-22dfc1653942 admin admin] PATH_INFO: `/v3/projects/827b3bd05f4e44f3b99f28752a6f16c7/users/c02c0e751b6c410388dcef50f3f914b4/roles/81a7cb1c95fd45708dbee5e4dc91626b` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.776877 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 587/1183] 10.222.0.58 () {60 vars in 1144 bytes} [Tue Aug 23 22:18:58 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 22:18:58.781216 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a687d91-5995-4b3e-b1b7-dc52d9311fc8 admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:58.792582 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a687d91-5995-4b3e-b1b7-dc52d9311fc8 admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:58.794208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945c748-87bf-47f9-bdc4-22dfc1653942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827b3bd05f4e44f3b99f28752a6f16c7, user_id=c02c0e751b6c410388dcef50f3f914b4, role_id=81a7cb1c95fd45708dbee5e4dc91626b)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:58.797025 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945c748-87bf-47f9-bdc4-22dfc1653942 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:58.797356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d766c-a345-4da8-9dc1-f50eb0a7ef12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:58.797966 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d766c-a345-4da8-9dc1-f50eb0a7ef12 admin admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.798250 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d766c-a345-4da8-9dc1-f50eb0a7ef12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.798526 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d766c-a345-4da8-9dc1-f50eb0a7ef12 admin admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.799346 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d766c-a345-4da8-9dc1-f50eb0a7ef12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:58.800823 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d766c-a345-4da8-9dc1-f50eb0a7ef12 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:58.813347 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 588/1184] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Aug 23 22:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:18:58.816802 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 597/1185] 10.222.0.58 () {60 vars in 1483 bytes} [Tue Aug 23 22:18:58 2022] PUT /identity/v3/projects/827b3bd05f4e44f3b99f28752a6f16c7/users/c02c0e751b6c410388dcef50f3f914b4/roles/81a7cb1c95fd45708dbee5e4dc91626b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:18:58.818360 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d766c-a345-4da8-9dc1-f50eb0a7ef12 admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:58.820388 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945c748-87bf-47f9-bdc4-22dfc1653942 admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:58.831285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d766c-a345-4da8-9dc1-f50eb0a7ef12 admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:58.894428 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945c748-87bf-47f9-bdc4-22dfc1653942 admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:58.903560 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef279c57-a431-4c86-ac74-7705379014ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:58.904676 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279c57-a431-4c86-ac74-7705379014ff admin admin] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.905164 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279c57-a431-4c86-ac74-7705379014ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.905665 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279c57-a431-4c86-ac74-7705379014ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.906016 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c27a5f-0da1-46a9-84f2-747ca2e813d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:58.906698 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c27a5f-0da1-46a9-84f2-747ca2e813d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:58.906887 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef279c57-a431-4c86-ac74-7705379014ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:58.906997 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c27a5f-0da1-46a9-84f2-747ca2e813d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:58.907238 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c27a5f-0da1-46a9-84f2-747ca2e813d3 admin admin] PATH_INFO: `/v3/projects/23ee95902763415399c1952e3cdcce04/users/636b9254224842c79c2d5a7d938b505a/roles/81a7cb1c95fd45708dbee5e4dc91626b` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:58.910085 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef279c57-a431-4c86-ac74-7705379014ff admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:58.926570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c27a5f-0da1-46a9-84f2-747ca2e813d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ee95902763415399c1952e3cdcce04, user_id=636b9254224842c79c2d5a7d938b505a, role_id=81a7cb1c95fd45708dbee5e4dc91626b)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:58.928993 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 598/1186] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Aug 23 22:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:18:58.929480 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c27a5f-0da1-46a9-84f2-747ca2e813d3 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:58.933759 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef279c57-a431-4c86-ac74-7705379014ff admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:58.944778 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef279c57-a431-4c86-ac74-7705379014ff admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:58.947922 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 589/1187] 10.222.0.58 () {60 vars in 1483 bytes} [Tue Aug 23 22:18:58 2022] PUT /identity/v3/projects/23ee95902763415399c1952e3cdcce04/users/636b9254224842c79c2d5a7d938b505a/roles/81a7cb1c95fd45708dbee5e4dc91626b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:18:58.951709 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c27a5f-0da1-46a9-84f2-747ca2e813d3 admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:59.022662 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:59.033819 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb4471-1e4f-41c6-b99a-6bf91f918992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:59.034460 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c27a5f-0da1-46a9-84f2-747ca2e813d3 admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:59.035468 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb4471-1e4f-41c6-b99a-6bf91f918992 admin admin] REQUEST_METHOD: `PUT` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:59.037615 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb4471-1e4f-41c6-b99a-6bf91f918992 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:59.038118 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb4471-1e4f-41c6-b99a-6bf91f918992 admin admin] PATH_INFO: `/v3/projects/827b3bd05f4e44f3b99f28752a6f16c7/users/c02c0e751b6c410388dcef50f3f914b4/roles/81a7cb1c95fd45708dbee5e4dc91626b` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:59.041914 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb4471-1e4f-41c6-b99a-6bf91f918992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=827b3bd05f4e44f3b99f28752a6f16c7, user_id=c02c0e751b6c410388dcef50f3f914b4, role_id=81a7cb1c95fd45708dbee5e4dc91626b)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:59.042680 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b8c8e-586f-4dbc-bf7e-eb6fbe9a1eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:59.043302 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b8c8e-586f-4dbc-bf7e-eb6fbe9a1eba admin admin] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:59.043586 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b8c8e-586f-4dbc-bf7e-eb6fbe9a1eba admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:59.043876 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b8c8e-586f-4dbc-bf7e-eb6fbe9a1eba admin admin] PATH_INFO: `/v3/roles` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:59.044522 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b8c8e-586f-4dbc-bf7e-eb6fbe9a1eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:59.046136 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b8c8e-586f-4dbc-bf7e-eb6fbe9a1eba admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:59.049217 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcb4471-1e4f-41c6-b99a-6bf91f918992 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:59.063887 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 590/1188] 10.222.0.58 () {58 vars in 1122 bytes} [Tue Aug 23 22:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 22:18:59.064662 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 599/1189] 10.222.0.58 () {60 vars in 1483 bytes} [Tue Aug 23 22:18:58 2022] PUT /identity/v3/projects/827b3bd05f4e44f3b99f28752a6f16c7/users/c02c0e751b6c410388dcef50f3f914b4/roles/81a7cb1c95fd45708dbee5e4dc91626b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:18:59.067519 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b8c8e-586f-4dbc-bf7e-eb6fbe9a1eba admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:18:59.084593 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b8c8e-586f-4dbc-bf7e-eb6fbe9a1eba admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:18:59.227081 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:18:59.238824 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affbf1f-d7e9-41fd-be85-f190e9d43221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:18:59.240490 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affbf1f-d7e9-41fd-be85-f190e9d43221 admin admin] REQUEST_METHOD: `PUT` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:18:59.240944 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affbf1f-d7e9-41fd-be85-f190e9d43221 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:18:59.244215 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affbf1f-d7e9-41fd-be85-f190e9d43221 admin admin] PATH_INFO: `/v3/projects/23ee95902763415399c1952e3cdcce04/users/636b9254224842c79c2d5a7d938b505a/roles/81a7cb1c95fd45708dbee5e4dc91626b` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:18:59.248125 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affbf1f-d7e9-41fd-be85-f190e9d43221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ee95902763415399c1952e3cdcce04, user_id=636b9254224842c79c2d5a7d938b505a, role_id=81a7cb1c95fd45708dbee5e4dc91626b)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:18:59.251565 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affbf1f-d7e9-41fd-be85-f190e9d43221 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:18:59.288959 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 591/1190] 10.222.0.58 () {60 vars in 1483 bytes} [Tue Aug 23 22:18:59 2022] PUT /identity/v3/projects/23ee95902763415399c1952e3cdcce04/users/636b9254224842c79c2d5a7d938b505a/roles/81a7cb1c95fd45708dbee5e4dc91626b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 22:19:05.354790 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdce919-a4d8-4fcc-b03f-8b614272bf49 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:05.355409 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdce919-a4d8-4fcc-b03f-8b614272bf49 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:05.355579 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdce919-a4d8-4fcc-b03f-8b614272bf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:05.380477 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2596-2870-4d3e-9d22-acfebb519f63 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:05.381496 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2596-2870-4d3e-9d22-acfebb519f63 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:05.384982 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2596-2870-4d3e-9d22-acfebb519f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:05.411593 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-3fdce919-a4d8-4fcc-b03f-8b614272bf49 None None] MFA Rules not processed for user `c02c0e751b6c410388dcef50f3f914b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:05.412771 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-3fdce919-a4d8-4fcc-b03f-8b614272bf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:05.426768 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-ca3c2596-2870-4d3e-9d22-acfebb519f63 None None] MFA Rules not processed for user `636b9254224842c79c2d5a7d938b505a`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:05.428562 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-ca3c2596-2870-4d3e-9d22-acfebb519f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:05.560513 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 592/1191] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:19:05 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:05.569103 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 600/1192] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:19:05 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:05.584868 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c2596-2870-4d3e-9d22-acfebb519f63 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:05.586570 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-ca3c2596-2870-4d3e-9d22-acfebb519f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:05.592414 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdce919-a4d8-4fcc-b03f-8b614272bf49 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:05.594086 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-3fdce919-a4d8-4fcc-b03f-8b614272bf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:05.705265 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c2596-2870-4d3e-9d22-acfebb519f63 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:05.714352 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdce919-a4d8-4fcc-b03f-8b614272bf49 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:05.714909 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55368e44-d48b-4a30-b952-17417f58e65c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18eb03a1a720431a9c78883a0aab8741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:05.715542 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55368e44-d48b-4a30-b952-17417f58e65c service glance] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:05.715818 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55368e44-d48b-4a30-b952-17417f58e65c service glance] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:05.716162 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55368e44-d48b-4a30-b952-17417f58e65c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:05.728518 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32ac06-a2a3-4ac9-9ba9-ea295d5c5d50 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18eb03a1a720431a9c78883a0aab8741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:05.730341 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32ac06-a2a3-4ac9-9ba9-ea295d5c5d50 service glance] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:05.730795 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32ac06-a2a3-4ac9-9ba9-ea295d5c5d50 service glance] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:05.731487 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32ac06-a2a3-4ac9-9ba9-ea295d5c5d50 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:05.815872 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32ac06-a2a3-4ac9-9ba9-ea295d5c5d50 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:05.818051 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32ac06-a2a3-4ac9-9ba9-ea295d5c5d50 service glance] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:05.818313 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55368e44-d48b-4a30-b952-17417f58e65c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:05.819968 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55368e44-d48b-4a30-b952-17417f58e65c service glance] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:05.833618 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 593/1194] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:05 2022] GET /identity/v3/auth/tokens => generated 2818 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:05.833931 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 601/1194] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:05 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:14.849128 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567cd2b-725f-4c9a-8312-417db4ab3273 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:14.849780 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567cd2b-725f-4c9a-8312-417db4ab3273 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:14.849780 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567cd2b-725f-4c9a-8312-417db4ab3273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:14.873888 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-6567cd2b-725f-4c9a-8312-417db4ab3273 None None] MFA Rules not processed for user `2845f6aa2ede4873b12c1e4a703a0ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:14.875622 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-6567cd2b-725f-4c9a-8312-417db4ab3273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:14.884272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 594/1195] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:19:14 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:15.198797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36785d-66bc-4780-9e40-99ab1d9a3cfd None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:15.199344 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36785d-66bc-4780-9e40-99ab1d9a3cfd None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:15.199344 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36785d-66bc-4780-9e40-99ab1d9a3cfd None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:15.200663 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 602/1196] 10.222.0.58 () {54 vars in 962 bytes} [Tue Aug 23 22:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:15.206451 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76c63-7e3c-4e77-8e21-c30f8ba2880c None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:15.206795 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76c63-7e3c-4e77-8e21-c30f8ba2880c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:15.207068 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c76c63-7e3c-4e77-8e21-c30f8ba2880c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:15.244198 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:15.269476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-94c76c63-7e3c-4e77-8e21-c30f8ba2880c None None] MFA Rules not processed for user `d43a6040fd95466fa17acdb1f30476ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:15.270697 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-94c76c63-7e3c-4e77-8e21-c30f8ba2880c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:15.350159 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 595/1197] 10.222.0.58 () {58 vars in 1059 bytes} [Tue Aug 23 22:19:15 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:15.360477 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b04bd-9238-46b7-b3cd-420c199554f4 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:15.360769 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b04bd-9238-46b7-b3cd-420c199554f4 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:15.361048 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b04bd-9238-46b7-b3cd-420c199554f4 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:15.363149 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 603/1198] 10.222.0.58 () {54 vars in 912 bytes} [Tue Aug 23 22:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:15.371921 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1f854-99d8-48aa-a28f-47b5389bf033 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:15.372318 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1f854-99d8-48aa-a28f-47b5389bf033 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:15.372647 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1f854-99d8-48aa-a28f-47b5389bf033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:15.396726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-a2d1f854-99d8-48aa-a28f-47b5389bf033 None None] MFA Rules not processed for user `d43a6040fd95466fa17acdb1f30476ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:15.398633 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-a2d1f854-99d8-48aa-a28f-47b5389bf033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:15.409998 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 596/1199] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Aug 23 22:19:15 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:15.424703 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b04bd-9238-46b7-b3cd-420c199554f4 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:15.437202 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b04bd-9238-46b7-b3cd-420c199554f4 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:15.441235 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123b062-3179-4c3b-9190-8c83cab91e92 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18eb03a1a720431a9c78883a0aab8741', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:15.441932 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123b062-3179-4c3b-9190-8c83cab91e92 service glance] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:15.442284 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123b062-3179-4c3b-9190-8c83cab91e92 service glance] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:15.442985 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123b062-3179-4c3b-9190-8c83cab91e92 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:15.454011 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123b062-3179-4c3b-9190-8c83cab91e92 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:15.455438 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123b062-3179-4c3b-9190-8c83cab91e92 service glance] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:15.466964 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 604/1200] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:15 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:15.869257 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291579fa-a28b-4dee-8014-09e4f76143b2 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:15.869846 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291579fa-a28b-4dee-8014-09e4f76143b2 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:15.869997 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291579fa-a28b-4dee-8014-09e4f76143b2 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:15.871330 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 597/1201] 10.222.0.58 () {54 vars in 912 bytes} [Tue Aug 23 22:19:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:15.876859 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a05abf-a1ae-4b1a-8c39-aa809613b475 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:15.877143 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a05abf-a1ae-4b1a-8c39-aa809613b475 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:15.877422 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a05abf-a1ae-4b1a-8c39-aa809613b475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:15.886721 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:15.914470 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-d9a05abf-a1ae-4b1a-8c39-aa809613b475 None None] MFA Rules not processed for user `b57524e5da8647a1a258f8c1e4258b62`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:15.916057 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-d9a05abf-a1ae-4b1a-8c39-aa809613b475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:15.975131 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 605/1202] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Aug 23 22:19:15 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:15.987963 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291579fa-a28b-4dee-8014-09e4f76143b2 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:16.000855 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291579fa-a28b-4dee-8014-09e4f76143b2 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:16.005615 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8ca26-13e2-4ed5-83c6-40aedc54c24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:16.006413 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8ca26-13e2-4ed5-83c6-40aedc54c24c service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:16.006704 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8ca26-13e2-4ed5-83c6-40aedc54c24c service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:16.006984 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8ca26-13e2-4ed5-83c6-40aedc54c24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:16.017098 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8ca26-13e2-4ed5-83c6-40aedc54c24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:16.019040 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8ca26-13e2-4ed5-83c6-40aedc54c24c service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:16.042222 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 598/1203] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:15 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:16.529803 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846d80c-ca04-42cb-9902-59af419d8373 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:16.530325 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846d80c-ca04-42cb-9902-59af419d8373 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:16.531039 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846d80c-ca04-42cb-9902-59af419d8373 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:16.532749 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 606/1204] 10.222.0.58 () {54 vars in 962 bytes} [Tue Aug 23 22:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:16.538993 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd51f0-320a-451f-97f4-d176ea56ea02 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:16.539281 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd51f0-320a-451f-97f4-d176ea56ea02 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:16.540182 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd51f0-320a-451f-97f4-d176ea56ea02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:16.543131 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce3c8a-fdbe-42ec-8493-5e1b0af9b6cf None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:16.543424 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce3c8a-fdbe-42ec-8493-5e1b0af9b6cf None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:16.543707 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce3c8a-fdbe-42ec-8493-5e1b0af9b6cf None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:16.545096 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 607/1205] 10.222.0.58 () {54 vars in 961 bytes} [Tue Aug 23 22:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:16.551310 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3732d-c7ba-4abc-a5f8-6f43589d3b43 None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:16.551598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3732d-c7ba-4abc-a5f8-6f43589d3b43 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:16.551919 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3732d-c7ba-4abc-a5f8-6f43589d3b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:16.568996 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-2bbd51f0-320a-451f-97f4-d176ea56ea02 None None] MFA Rules not processed for user `d43a6040fd95466fa17acdb1f30476ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:16.570128 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-2bbd51f0-320a-451f-97f4-d176ea56ea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:16.575298 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-24e3732d-c7ba-4abc-a5f8-6f43589d3b43 None None] MFA Rules not processed for user `7a55d53b8c1a4dffa00b9114d1df498a`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:16.576570 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-24e3732d-c7ba-4abc-a5f8-6f43589d3b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:16.582211 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 599/1206] 10.222.0.58 () {58 vars in 1059 bytes} [Tue Aug 23 22:19:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:16.588656 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b301f-d809-4890-9fde-f6c792320cd3 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:16.589033 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b301f-d809-4890-9fde-f6c792320cd3 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:16.589429 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b301f-d809-4890-9fde-f6c792320cd3 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:16.591131 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 600/1207] 10.222.0.58 () {54 vars in 912 bytes} [Tue Aug 23 22:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:19:16.598370 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1fa13-8ce5-4a34-83cb-595c4a051e81 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:16.599143 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1fa13-8ce5-4a34-83cb-595c4a051e81 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:16.599494 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1fa13-8ce5-4a34-83cb-595c4a051e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:16.631100 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-f0e1fa13-8ce5-4a34-83cb-595c4a051e81 None None] MFA Rules not processed for user `d43a6040fd95466fa17acdb1f30476ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:16.632683 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-f0e1fa13-8ce5-4a34-83cb-595c4a051e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:16.643794 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 601/1208] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Aug 23 22:19:16 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:16.657289 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1fa13-8ce5-4a34-83cb-595c4a051e81 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:16.662633 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 608/1209] 10.222.0.58 () {58 vars in 1058 bytes} [Tue Aug 23 22:19:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:19:16.669442 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1fa13-8ce5-4a34-83cb-595c4a051e81 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:16.672543 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3732d-c7ba-4abc-a5f8-6f43589d3b43 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:16.673599 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccacc7f-c5f1-4a85-aa26-a2da476f80bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:16.674213 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacc7f-c5f1-4a85-aa26-a2da476f80bd service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:16.674493 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacc7f-c5f1-4a85-aa26-a2da476f80bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:16.674766 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccacc7f-c5f1-4a85-aa26-a2da476f80bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:16.686724 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3732d-c7ba-4abc-a5f8-6f43589d3b43 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:16.687102 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccacc7f-c5f1-4a85-aa26-a2da476f80bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:16.688809 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccacc7f-c5f1-4a85-aa26-a2da476f80bd service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:16.693008 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605afaf-c41b-42c5-8d2e-79d6c4b0ad18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55d53b8c1a4dffa00b9114d1df498a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:16.694106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605afaf-c41b-42c5-8d2e-79d6c4b0ad18 service placement] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:16.694389 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605afaf-c41b-42c5-8d2e-79d6c4b0ad18 service placement] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:16.694661 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605afaf-c41b-42c5-8d2e-79d6c4b0ad18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:16.698040 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-9605afaf-c41b-42c5-8d2e-79d6c4b0ad18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:16.713639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605afaf-c41b-42c5-8d2e-79d6c4b0ad18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:16.714374 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 602/1210] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:19:16.716268 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605afaf-c41b-42c5-8d2e-79d6c4b0ad18 service placement] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:16.734563 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 609/1211] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:16 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:19:26.696037 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=50 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:26.728893 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=61 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:27.427496 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232bb2e-0db7-453c-b7b6-21c8af1a244c None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:27.427939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232bb2e-0db7-453c-b7b6-21c8af1a244c None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:27.428302 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232bb2e-0db7-453c-b7b6-21c8af1a244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:27.451935 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-e232bb2e-0db7-453c-b7b6-21c8af1a244c None None] MFA Rules not processed for user `b57524e5da8647a1a258f8c1e4258b62`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:27.454112 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-e232bb2e-0db7-453c-b7b6-21c8af1a244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:27.463973 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 603/1212] 10.222.0.17 () {58 vars in 1015 bytes} [Tue Aug 23 22:19:27 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:27.477038 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605afaf-c41b-42c5-8d2e-79d6c4b0ad18 service placement] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:27.478989 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-9605afaf-c41b-42c5-8d2e-79d6c4b0ad18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:27.491864 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605afaf-c41b-42c5-8d2e-79d6c4b0ad18 service placement] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:27.496416 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cad53-d32a-4c60-9cb3-55c016e669fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:27.497036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cad53-d32a-4c60-9cb3-55c016e669fe service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:27.497311 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cad53-d32a-4c60-9cb3-55c016e669fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:27.497588 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cad53-d32a-4c60-9cb3-55c016e669fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:27.507208 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cad53-d32a-4c60-9cb3-55c016e669fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:27.509945 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cad53-d32a-4c60-9cb3-55c016e669fe service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:27.520066 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 610/1213] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:27 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:19:28.380924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34223-fb3a-4832-8093-07ea90fbc3e7 None None] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:28.380924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34223-fb3a-4832-8093-07ea90fbc3e7 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:28.380924 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34223-fb3a-4832-8093-07ea90fbc3e7 None None] PATH_INFO: `/` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:28.382496 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 604/1214] 10.222.0.58 () {54 vars in 921 bytes} [Tue Aug 23 22:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:19:28.405172 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058f4c-fb30-4c63-a1f5-0fbe914771ce None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:28.405792 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058f4c-fb30-4c63-a1f5-0fbe914771ce None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:28.406365 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058f4c-fb30-4c63-a1f5-0fbe914771ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:28.438938 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-7f058f4c-fb30-4c63-a1f5-0fbe914771ce None None] MFA Rules not processed for user `d43a6040fd95466fa17acdb1f30476ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:28.440859 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-7f058f4c-fb30-4c63-a1f5-0fbe914771ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:28.452433 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 611/1215] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Aug 23 22:19:28 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:28.505584 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e34223-fb3a-4832-8093-07ea90fbc3e7 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:28.522481 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e34223-fb3a-4832-8093-07ea90fbc3e7 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:28.529484 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65853a0f-f01f-4224-9946-1a242f056911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:28.530042 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65853a0f-f01f-4224-9946-1a242f056911 service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:28.530324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65853a0f-f01f-4224-9946-1a242f056911 service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:28.530604 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65853a0f-f01f-4224-9946-1a242f056911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:28.541939 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65853a0f-f01f-4224-9946-1a242f056911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:28.544710 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65853a0f-f01f-4224-9946-1a242f056911 service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:28.563937 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 605/1216] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:28 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:35.814099 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bbffc-cfa5-42e7-92df-bc4d734869aa None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:35.814996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bbffc-cfa5-42e7-92df-bc4d734869aa None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:35.814996 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bbffc-cfa5-42e7-92df-bc4d734869aa None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:35.816540 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 612/1217] 10.222.0.58 () {54 vars in 921 bytes} [Tue Aug 23 22:19:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:19:35.831333 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bf122-96cd-42b6-9967-f5af4df214f2 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:35.831866 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bf122-96cd-42b6-9967-f5af4df214f2 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:35.832022 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bf122-96cd-42b6-9967-f5af4df214f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:35.859401 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-693bf122-96cd-42b6-9967-f5af4df214f2 None None] MFA Rules not processed for user `d43a6040fd95466fa17acdb1f30476ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:35.860778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-693bf122-96cd-42b6-9967-f5af4df214f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:35.872181 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 606/1218] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Aug 23 22:19:35 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 22:19:35.902984 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bbffc-cfa5-42e7-92df-bc4d734869aa None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:35.926279 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bbffc-cfa5-42e7-92df-bc4d734869aa None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:35.934829 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa45ed7-f4ed-43f8-bb19-c10e68242557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:35.935613 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa45ed7-f4ed-43f8-bb19-c10e68242557 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:35.935782 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa45ed7-f4ed-43f8-bb19-c10e68242557 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:35.936024 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa45ed7-f4ed-43f8-bb19-c10e68242557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:35.945231 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa45ed7-f4ed-43f8-bb19-c10e68242557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:35.947587 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa45ed7-f4ed-43f8-bb19-c10e68242557 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:35.959074 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 613/1219] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:35 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:19:45.851871 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=12 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:45.954463 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=15 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:19:48.017135 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bf122-96cd-42b6-9967-f5af4df214f2 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:48.030161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bf122-96cd-42b6-9967-f5af4df214f2 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:48.035637 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f66f1-7202-4337-b0c5-d30bd43fee8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:48.036616 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f66f1-7202-4337-b0c5-d30bd43fee8b service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:48.037056 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f66f1-7202-4337-b0c5-d30bd43fee8b service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:48.037484 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f66f1-7202-4337-b0c5-d30bd43fee8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:48.052669 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f66f1-7202-4337-b0c5-d30bd43fee8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:48.055084 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f66f1-7202-4337-b0c5-d30bd43fee8b service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:48.070723 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 607/1220] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:48 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:19:52.918236 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8b31c-1683-4c72-addc-e65f31ea9b2b None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:52.919117 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8b31c-1683-4c72-addc-e65f31ea9b2b None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:52.919117 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8b31c-1683-4c72-addc-e65f31ea9b2b None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:52.920704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 614/1221] 10.222.0.58 () {54 vars in 921 bytes} [Tue Aug 23 22:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 22:19:52.935117 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a0f1c-4d68-4a6b-81ba-85b00851c7e0 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:52.937126 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a0f1c-4d68-4a6b-81ba-85b00851c7e0 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:52.938004 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a0f1c-4d68-4a6b-81ba-85b00851c7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:52.983161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-874a0f1c-4d68-4a6b-81ba-85b00851c7e0 None None] MFA Rules not processed for user `d43a6040fd95466fa17acdb1f30476ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:19:52.985551 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-874a0f1c-4d68-4a6b-81ba-85b00851c7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:19:52.999253 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 608/1222] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Aug 23 22:19:52 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:19:53.027460 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8b31c-1683-4c72-addc-e65f31ea9b2b None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:19:53.076704 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8b31c-1683-4c72-addc-e65f31ea9b2b None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:19:53.082349 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8565a-d7e6-4459-ad63-562438b976e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:19:53.082951 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8565a-d7e6-4459-ad63-562438b976e2 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:19:53.083223 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8565a-d7e6-4459-ad63-562438b976e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:19:53.083685 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8565a-d7e6-4459-ad63-562438b976e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:19:53.117347 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8565a-d7e6-4459-ad63-562438b976e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:19:53.126730 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8565a-d7e6-4459-ad63-562438b976e2 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:19:53.168106 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 615/1223] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:19:53 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:02.972264 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=9 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:03.147886 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=6 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:15.023854 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64befc-d402-414f-8405-4b8e823a9c54 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:15.024490 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64befc-d402-414f-8405-4b8e823a9c54 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:15.024633 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64befc-d402-414f-8405-4b8e823a9c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:15.044473 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-bf64befc-d402-414f-8405-4b8e823a9c54 None None] MFA Rules not processed for user `93cd01203fcf457291cc4146432580c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:15.045693 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-bf64befc-d402-414f-8405-4b8e823a9c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:15.060173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 609/1224] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:20:15 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:15.612154 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3d49d-f02d-47ab-ad76-21176e9e421d None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:15.612819 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3d49d-f02d-47ab-ad76-21176e9e421d None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:15.613017 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3d49d-f02d-47ab-ad76-21176e9e421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:15.645808 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-a7e3d49d-f02d-47ab-ad76-21176e9e421d None None] MFA Rules not processed for user `b57524e5da8647a1a258f8c1e4258b62`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:15.647679 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-a7e3d49d-f02d-47ab-ad76-21176e9e421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:15.657814 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 616/1225] 10.222.0.58 () {58 vars in 1009 bytes} [Tue Aug 23 22:20:15 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:15.674685 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64befc-d402-414f-8405-4b8e823a9c54 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:20:15.686295 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64befc-d402-414f-8405-4b8e823a9c54 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:20:15.691495 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920acb0-8ad5-442d-8f3c-22b229fd26fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:20:15.692278 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920acb0-8ad5-442d-8f3c-22b229fd26fd service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:15.692563 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920acb0-8ad5-442d-8f3c-22b229fd26fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:15.692837 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920acb0-8ad5-442d-8f3c-22b229fd26fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:15.703326 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920acb0-8ad5-442d-8f3c-22b229fd26fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:20:15.706078 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920acb0-8ad5-442d-8f3c-22b229fd26fd service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:20:15.716112 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 610/1226] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:20:15 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:20:25.638781 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=3 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:25.711768 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=9 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:41.162594 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940f6fd-b414-4c6f-8edd-afaa9946c3db None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:41.163073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940f6fd-b414-4c6f-8edd-afaa9946c3db None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:41.163154 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940f6fd-b414-4c6f-8edd-afaa9946c3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:41.183037 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-a940f6fd-b414-4c6f-8edd-afaa9946c3db None None] MFA Rules not processed for user `93cd01203fcf457291cc4146432580c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:41.184276 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-a940f6fd-b414-4c6f-8edd-afaa9946c3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:41.191000 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 617/1227] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:20:41 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:20:51.177925 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=3 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:20:53.853004 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cee6b-341b-443d-8933-9e552ffabdcf None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:20:53.853754 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cee6b-341b-443d-8933-9e552ffabdcf None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:20:53.853892 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cee6b-341b-443d-8933-9e552ffabdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:20:53.881335 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-6b9cee6b-341b-443d-8933-9e552ffabdcf None None] MFA Rules not processed for user `93cd01203fcf457291cc4146432580c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:20:53.884002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-6b9cee6b-341b-443d-8933-9e552ffabdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:20:53.893145 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 611/1228] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:20:53 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:21:03.874200 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=3 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:21:51.696803 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80618-7ab1-4054-a3f3-42dad84e076e None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:21:51.697317 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80618-7ab1-4054-a3f3-42dad84e076e None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:21:51.697413 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e80618-7ab1-4054-a3f3-42dad84e076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:21:51.716236 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-c5e80618-7ab1-4054-a3f3-42dad84e076e None None] MFA Rules not processed for user `93cd01203fcf457291cc4146432580c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:21:51.717434 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-c5e80618-7ab1-4054-a3f3-42dad84e076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:21:51.725124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 618/1229] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:21:51 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:22:01.711586 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=3 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:22:05.739726 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cee6b-341b-443d-8933-9e552ffabdcf None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:22:05.759713 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cee6b-341b-443d-8933-9e552ffabdcf None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:22:05.763247 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc7167-05d3-48a9-950f-7c9ec6a8db91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:22:05.763863 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc7167-05d3-48a9-950f-7c9ec6a8db91 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:22:05.764147 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc7167-05d3-48a9-950f-7c9ec6a8db91 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:22:05.764414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc7167-05d3-48a9-950f-7c9ec6a8db91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:22:05.774697 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc7167-05d3-48a9-950f-7c9ec6a8db91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:22:05.776153 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc7167-05d3-48a9-950f-7c9ec6a8db91 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:22:05.785472 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 612/1230] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:22:05 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:22:15.781659 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=10 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:21.716052 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e80618-7ab1-4054-a3f3-42dad84e076e None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:23:21.737747 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e80618-7ab1-4054-a3f3-42dad84e076e None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:23:21.742722 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94960-0b9a-4849-b153-09fdb3286587 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55d53b8c1a4dffa00b9114d1df498a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:23:21.743318 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94960-0b9a-4849-b153-09fdb3286587 service placement] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:21.743598 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94960-0b9a-4849-b153-09fdb3286587 service placement] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:21.744163 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94960-0b9a-4849-b153-09fdb3286587 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:21.752211 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec94960-0b9a-4849-b153-09fdb3286587 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:23:21.753795 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec94960-0b9a-4849-b153-09fdb3286587 service placement] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:23:21.765402 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 619/1231] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:23:21 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:23:31.760973 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=10 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:23:38.268111 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ebeb0-994f-406b-b0fd-2dce103d490a None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:23:38.268671 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ebeb0-994f-406b-b0fd-2dce103d490a None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:23:38.268825 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ebeb0-994f-406b-b0fd-2dce103d490a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:23:38.289593 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-4b1ebeb0-994f-406b-b0fd-2dce103d490a None None] MFA Rules not processed for user `2845f6aa2ede4873b12c1e4a703a0ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:23:38.290785 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-4b1ebeb0-994f-406b-b0fd-2dce103d490a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:23:38.297828 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 613/1232] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:23:38 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:23:48.283778 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=3 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:05.908975 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94960-0b9a-4849-b153-09fdb3286587 service placement] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:05.919125 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94960-0b9a-4849-b153-09fdb3286587 service placement] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:05.923639 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd82758-f373-43c6-b528-3a54590da6e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:05.924229 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd82758-f373-43c6-b528-3a54590da6e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:05.924510 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd82758-f373-43c6-b528-3a54590da6e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:05.924807 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd82758-f373-43c6-b528-3a54590da6e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:05.935092 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd82758-f373-43c6-b528-3a54590da6e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:05.936602 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd82758-f373-43c6-b528-3a54590da6e2 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:05.948946 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 620/1233] 10.222.0.58 () {60 vars in 1396 bytes} [Tue Aug 23 22:24:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 2818 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:15.415296 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ebeb0-994f-406b-b0fd-2dce103d490a None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:15.436393 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ebeb0-994f-406b-b0fd-2dce103d490a None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:15.441972 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52f867-bf62-48e5-9622-9da68489467e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:15.442573 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52f867-bf62-48e5-9622-9da68489467e service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:15.442853 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52f867-bf62-48e5-9622-9da68489467e service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:15.443150 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52f867-bf62-48e5-9622-9da68489467e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:15.451414 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52f867-bf62-48e5-9622-9da68489467e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:15.453115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52f867-bf62-48e5-9622-9da68489467e service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:15.462964 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 614/1234] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:15 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:15.943630 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=6 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:16.827745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd82758-f373-43c6-b528-3a54590da6e2 service neutron] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:16.837473 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd82758-f373-43c6-b528-3a54590da6e2 service neutron] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:16.841672 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58272cfd-483e-44bb-a76e-7a95d3a3430d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:16.842318 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272cfd-483e-44bb-a76e-7a95d3a3430d service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:16.842628 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272cfd-483e-44bb-a76e-7a95d3a3430d service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:16.842936 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58272cfd-483e-44bb-a76e-7a95d3a3430d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:16.854055 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58272cfd-483e-44bb-a76e-7a95d3a3430d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:16.855495 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58272cfd-483e-44bb-a76e-7a95d3a3430d service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:16.872677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 621/1235] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:16 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:18.089745 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52f867-bf62-48e5-9622-9da68489467e service nova] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:18.100115 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52f867-bf62-48e5-9622-9da68489467e service nova] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:18.104027 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2f8cf-fa8e-496d-b07c-04c43504ba04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:18.104642 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2f8cf-fa8e-496d-b07c-04c43504ba04 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:18.104925 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2f8cf-fa8e-496d-b07c-04c43504ba04 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:18.105190 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2f8cf-fa8e-496d-b07c-04c43504ba04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:18.116279 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2f8cf-fa8e-496d-b07c-04c43504ba04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:18.117730 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2f8cf-fa8e-496d-b07c-04c43504ba04 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:18.130202 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 615/1236] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:18 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:20.476280 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518aaad-d01d-4b93-890b-caef5e7f4cfa None None] REQUEST_METHOD: `POST` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:20.476796 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518aaad-d01d-4b93-890b-caef5e7f4cfa None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:20.476888 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518aaad-d01d-4b93-890b-caef5e7f4cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:20.497430 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.auth.core [None req-5518aaad-d01d-4b93-890b-caef5e7f4cfa None None] MFA Rules not processed for user `93cd01203fcf457291cc4146432580c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88404) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:24:20.498717 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-5518aaad-d01d-4b93-890b-caef5e7f4cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:24:20.506267 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 622/1237] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:24:20 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:24:21.336912 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2f8cf-fa8e-496d-b07c-04c43504ba04 service neutron] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:21.351164 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2f8cf-fa8e-496d-b07c-04c43504ba04 service neutron] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:21.357008 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82479e33-e427-4c47-8e6f-1001f97d8f67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55d53b8c1a4dffa00b9114d1df498a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:21.357619 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82479e33-e427-4c47-8e6f-1001f97d8f67 service placement] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:21.357899 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82479e33-e427-4c47-8e6f-1001f97d8f67 service placement] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:21.358173 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82479e33-e427-4c47-8e6f-1001f97d8f67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:21.368448 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82479e33-e427-4c47-8e6f-1001f97d8f67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:21.370196 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82479e33-e427-4c47-8e6f-1001f97d8f67 service placement] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:21.380735 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 616/1238] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:21 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:30.492585 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=9 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:31.376393 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=22 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:31.972555 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518aaad-d01d-4b93-890b-caef5e7f4cfa None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:31.983281 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518aaad-d01d-4b93-890b-caef5e7f4cfa None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:31.987212 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3748c0-9736-4259-bf21-7bd3f80d1c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:31.988902 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3748c0-9736-4259-bf21-7bd3f80d1c9a service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:31.989233 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3748c0-9736-4259-bf21-7bd3f80d1c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:31.989507 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3748c0-9736-4259-bf21-7bd3f80d1c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:31.997824 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3748c0-9736-4259-bf21-7bd3f80d1c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:31.999322 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3748c0-9736-4259-bf21-7bd3f80d1c9a service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:32.009682 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 623/1239] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:31 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:24:36.645591 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82479e33-e427-4c47-8e6f-1001f97d8f67 service placement] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:24:36.665211 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82479e33-e427-4c47-8e6f-1001f97d8f67 service placement] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:24:36.673787 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc1103-3f4e-481b-bfd9-c2e503423b9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:24:36.674519 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc1103-3f4e-481b-bfd9-c2e503423b9e service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:24:36.675482 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc1103-3f4e-481b-bfd9-c2e503423b9e service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:24:36.675748 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc1103-3f4e-481b-bfd9-c2e503423b9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:24:36.687447 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc1103-3f4e-481b-bfd9-c2e503423b9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:24:36.689760 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc1103-3f4e-481b-bfd9-c2e503423b9e service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:24:36.702185 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 617/1240] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:24:36 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:24:42.005163 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=6 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:24:46.698024 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=6 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:19.830406 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3748c0-9736-4259-bf21-7bd3f80d1c9a service neutron] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:19.846268 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3748c0-9736-4259-bf21-7bd3f80d1c9a service neutron] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:19.852298 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361c57d-e774-494d-b3fd-6134aa69c0b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:19.853022 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c57d-e774-494d-b3fd-6134aa69c0b2 service nova] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:19.853371 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c57d-e774-494d-b3fd-6134aa69c0b2 service nova] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:19.853716 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c57d-e774-494d-b3fd-6134aa69c0b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:19.864511 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361c57d-e774-494d-b3fd-6134aa69c0b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:19.867183 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361c57d-e774-494d-b3fd-6134aa69c0b2 service nova] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:19.878942 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 624/1241] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:19 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 22:25:27.930742 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc1103-3f4e-481b-bfd9-c2e503423b9e service nova] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:27.941550 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc1103-3f4e-481b-bfd9-c2e503423b9e service nova] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:27.945938 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7c1e2-581b-4fbb-8507-5d652fadb87a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:27.946578 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7c1e2-581b-4fbb-8507-5d652fadb87a service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:27.946905 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7c1e2-581b-4fbb-8507-5d652fadb87a service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:27.947212 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7c1e2-581b-4fbb-8507-5d652fadb87a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:28.016676 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7c1e2-581b-4fbb-8507-5d652fadb87a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:28.018146 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d7c1e2-581b-4fbb-8507-5d652fadb87a service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:28.038002 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 618/1242] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:29.874742 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=6 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:31.741773 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da3645-024f-4022-987b-e3920e840988 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:31.742359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da3645-024f-4022-987b-e3920e840988 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:31.742359 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da3645-024f-4022-987b-e3920e840988 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:31.743594 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 625/1243] 10.222.0.58 () {54 vars in 921 bytes} [Tue Aug 23 22:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:25:31.771941 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53410be3-ffc7-4e48-ab9a-17cb8f2675d8 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:31.772476 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53410be3-ffc7-4e48-ab9a-17cb8f2675d8 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:31.772869 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53410be3-ffc7-4e48-ab9a-17cb8f2675d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:31.843400 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-53410be3-ffc7-4e48-ab9a-17cb8f2675d8 None None] MFA Rules not processed for user `7a55d53b8c1a4dffa00b9114d1df498a`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:25:31.844992 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-53410be3-ffc7-4e48-ab9a-17cb8f2675d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:31.854594 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 619/1244] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Aug 23 22:25:31 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:25:31.867114 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da3645-024f-4022-987b-e3920e840988 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:31.881449 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da3645-024f-4022-987b-e3920e840988 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:31.887160 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83456516-f528-489b-b8e7-3f2a34e596b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55d53b8c1a4dffa00b9114d1df498a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:31.887775 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83456516-f528-489b-b8e7-3f2a34e596b2 service placement] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:31.888080 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83456516-f528-489b-b8e7-3f2a34e596b2 service placement] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:31.888361 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83456516-f528-489b-b8e7-3f2a34e596b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:31.898109 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83456516-f528-489b-b8e7-3f2a34e596b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:31.899695 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83456516-f528-489b-b8e7-3f2a34e596b2 service placement] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:31.910164 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 626/1245] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:25:31 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:25:34.989133 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53410be3-ffc7-4e48-ab9a-17cb8f2675d8 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:35.004051 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53410be3-ffc7-4e48-ab9a-17cb8f2675d8 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:35.008948 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:35.010412 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:35.010735 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:35.011010 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] PATH_INFO: `/v3/users/2845f6aa2ede4873b12c1e4a703a0ddd` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:35.012193 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2845f6aa2ede4873b12c1e4a703a0ddd)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:35.013290 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: WARNING py.warnings [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:25:35.013290 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: warnings.warn(msg) Aug 23 22:25:35.013290 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: Aug 23 22:25:35.014859 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:35.081833 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2845f6aa2ede4873b12c1e4a703a0ddd'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.092953 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2845f6aa2ede4873b12c1e4a703a0ddd'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.093671 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2845f6aa2ede4873b12c1e4a703a0ddd'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.094285 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2845f6aa2ede4873b12c1e4a703a0ddd'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.101869 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2845f6aa2ede4873b12c1e4a703a0ddd'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.127763 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 620/1246] 10.222.0.58 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:34 2022] DELETE /identity/v3/users/2845f6aa2ede4873b12c1e4a703a0ddd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:35.322923 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83456516-f528-489b-b8e7-3f2a34e596b2 service placement] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:35.335643 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83456516-f528-489b-b8e7-3f2a34e596b2 service placement] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:35.397253 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:35.397884 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:35.398158 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:35.398430 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] PATH_INFO: `/v3/projects/9bb6dd312829496eae2a76fbf0f3b55c` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:35.399781 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb6dd312829496eae2a76fbf0f3b55c)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:35.401256 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: WARNING py.warnings [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 22:25:35.401256 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: warnings.warn(msg) Aug 23 22:25:35.401256 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: Aug 23 22:25:35.402610 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:35.465601 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb6dd312829496eae2a76fbf0f3b55c', 'request_id': 'req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.480464 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb6dd312829496eae2a76fbf0f3b55c', 'request_id': 'req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.489652 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb6dd312829496eae2a76fbf0f3b55c', 'request_id': 'req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.505676 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] The token cache is being invalidate because project 9bb6dd312829496eae2a76fbf0f3b55c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:35.506041 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.506715 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.508256 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 627/1247] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:35 2022] DELETE /identity/v3/projects/9bb6dd312829496eae2a76fbf0f3b55c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:35.512894 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:35.514338 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:35.530810 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd47941-e24a-4a85-81e6-caecbed5c695 admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:35.546844 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:35.597397 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782004c-db79-4481-850d-8bf76b323652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:35.598032 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782004c-db79-4481-850d-8bf76b323652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:35.598310 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782004c-db79-4481-850d-8bf76b323652 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:35.598581 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782004c-db79-4481-850d-8bf76b323652 admin admin] PATH_INFO: `/v3/users/c02c0e751b6c410388dcef50f3f914b4` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:35.599688 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782004c-db79-4481-850d-8bf76b323652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c02c0e751b6c410388dcef50f3f914b4)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:35.601910 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782004c-db79-4481-850d-8bf76b323652 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:35.655733 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-0782004c-db79-4481-850d-8bf76b323652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c02c0e751b6c410388dcef50f3f914b4'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.663510 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-0782004c-db79-4481-850d-8bf76b323652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c02c0e751b6c410388dcef50f3f914b4'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.664719 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-0782004c-db79-4481-850d-8bf76b323652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c02c0e751b6c410388dcef50f3f914b4'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.666205 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-0782004c-db79-4481-850d-8bf76b323652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c02c0e751b6c410388dcef50f3f914b4'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.675735 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-0782004c-db79-4481-850d-8bf76b323652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c02c0e751b6c410388dcef50f3f914b4'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:35.696092 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 621/1248] 10.222.0.58 () {58 vars in 1224 bytes} [Tue Aug 23 22:25:35 2022] DELETE /identity/v3/users/c02c0e751b6c410388dcef50f3f914b4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:35.899745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:25:35.902077 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:25:35.920069 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb6a0b-f47e-4ca8-ac05-b1da89c27bcf admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:25:35.990323 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:25:35.991405 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:25:35.991690 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:25:35.992036 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] PATH_INFO: `/v3/projects/827b3bd05f4e44f3b99f28752a6f16c7` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:25:35.993880 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=827b3bd05f4e44f3b99f28752a6f16c7)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:25:35.996698 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:25:36.024562 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:36.059078 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '827b3bd05f4e44f3b99f28752a6f16c7', 'request_id': 'req-110f0441-2d30-4713-939c-ac2e08b1e699'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:36.065569 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '827b3bd05f4e44f3b99f28752a6f16c7', 'request_id': 'req-110f0441-2d30-4713-939c-ac2e08b1e699'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:36.074491 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '827b3bd05f4e44f3b99f28752a6f16c7', 'request_id': 'req-110f0441-2d30-4713-939c-ac2e08b1e699'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:36.087275 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] The token cache is being invalidate because project 827b3bd05f4e44f3b99f28752a6f16c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:25:36.088350 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:36.089418 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:25:36.092450 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 628/1249] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Aug 23 22:25:35 2022] DELETE /identity/v3/projects/827b3bd05f4e44f3b99f28752a6f16c7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:25:45.692495 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:25:46.082785 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:21.063702 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c893f5-ea11-416f-bf30-bbed814c9511 None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:21.064260 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c893f5-ea11-416f-bf30-bbed814c9511 None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:21.064260 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c893f5-ea11-416f-bf30-bbed814c9511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:21.083361 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-80c893f5-ea11-416f-bf30-bbed814c9511 None None] MFA Rules not processed for user `93cd01203fcf457291cc4146432580c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:26:21.084575 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-80c893f5-ea11-416f-bf30-bbed814c9511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:21.139356 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 622/1250] 10.222.0.58 () {58 vars in 958 bytes} [Tue Aug 23 22:26:21 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:26:21.462728 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:21.464225 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:21.522330 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f0441-2d30-4713-939c-ac2e08b1e699 admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:21.525924 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd21978-a66c-4b75-9640-06eacade05a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:21.526531 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd21978-a66c-4b75-9640-06eacade05a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:21.526811 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd21978-a66c-4b75-9640-06eacade05a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:21.527082 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd21978-a66c-4b75-9640-06eacade05a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:21.529353 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-9cd21978-a66c-4b75-9640-06eacade05a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:21.538626 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd21978-a66c-4b75-9640-06eacade05a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:21.540075 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd21978-a66c-4b75-9640-06eacade05a8 service neutron] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:21.548462 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 629/1251] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:21 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:31.132277 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=25 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:31.545286 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=26 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:26:32.226393 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c893f5-ea11-416f-bf30-bbed814c9511 None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:26:32.228221 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-80c893f5-ea11-416f-bf30-bbed814c9511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:32.314193 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c893f5-ea11-416f-bf30-bbed814c9511 None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:26:32.319386 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754de3f9-e584-4b43-a3f5-dce52bc1adcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd43a6040fd95466fa17acdb1f30476ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:26:32.320048 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754de3f9-e584-4b43-a3f5-dce52bc1adcd service nova] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:26:32.320333 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754de3f9-e584-4b43-a3f5-dce52bc1adcd service nova] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:26:32.320609 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754de3f9-e584-4b43-a3f5-dce52bc1adcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:26:32.322350 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-754de3f9-e584-4b43-a3f5-dce52bc1adcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:26:32.335133 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754de3f9-e584-4b43-a3f5-dce52bc1adcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:26:32.336767 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754de3f9-e584-4b43-a3f5-dce52bc1adcd service nova] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:26:32.348434 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 623/1252] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:26:32 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:26:42.343533 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=32 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:28:25.819356 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd21978-a66c-4b75-9640-06eacade05a8 service neutron] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:28:25.820883 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-9cd21978-a66c-4b75-9640-06eacade05a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:25.949343 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd21978-a66c-4b75-9640-06eacade05a8 service neutron] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:28:25.954447 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5845d-cb0c-4e71-acea-041d6328f4b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55d53b8c1a4dffa00b9114d1df498a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:28:25.955073 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5845d-cb0c-4e71-acea-041d6328f4b6 service placement] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:28:25.955352 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5845d-cb0c-4e71-acea-041d6328f4b6 service placement] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:28:25.955648 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5845d-cb0c-4e71-acea-041d6328f4b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:28:25.957427 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-bac5845d-cb0c-4e71-acea-041d6328f4b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:28:25.970016 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5845d-cb0c-4e71-acea-041d6328f4b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:28:25.971635 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5845d-cb0c-4e71-acea-041d6328f4b6 service placement] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:28:25.981772 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 630/1253] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:28:25 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:28:35.978553 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=54 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:13.344654 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754de3f9-e584-4b43-a3f5-dce52bc1adcd service nova] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:13.364963 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754de3f9-e584-4b43-a3f5-dce52bc1adcd service nova] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:13.368979 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f6245-c70a-4220-acc6-f29358fc04c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57524e5da8647a1a258f8c1e4258b62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:13.369742 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f6245-c70a-4220-acc6-f29358fc04c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:13.370046 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f6245-c70a-4220-acc6-f29358fc04c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:13.370321 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f6245-c70a-4220-acc6-f29358fc04c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:13.372699 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-182f6245-c70a-4220-acc6-f29358fc04c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:13.461844 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f6245-c70a-4220-acc6-f29358fc04c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:13.463292 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f6245-c70a-4220-acc6-f29358fc04c2 service neutron] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:13.474113 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 624/1254] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:16.585030 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09092ddf-8f02-4b16-a0fa-eb08e0b90cb0 None None] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.585545 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09092ddf-8f02-4b16-a0fa-eb08e0b90cb0 None None] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.585650 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09092ddf-8f02-4b16-a0fa-eb08e0b90cb0 None None] PATH_INFO: `/` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.587099 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 631/1255] 10.222.0.58 () {54 vars in 921 bytes} [Tue Aug 23 22:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 22:29:16.598609 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a0a95-b11d-4ebb-842b-3952ac4303cd None None] REQUEST_METHOD: `POST` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.599053 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a0a95-b11d-4ebb-842b-3952ac4303cd None None] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.599226 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a0a95-b11d-4ebb-842b-3952ac4303cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.631324 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.auth.core [None req-8e4a0a95-b11d-4ebb-842b-3952ac4303cd None None] MFA Rules not processed for user `7a55d53b8c1a4dffa00b9114d1df498a`. Rule list: `[]` (Enabled: `True`). {{(pid=88405) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 22:29:16.632593 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-8e4a0a95-b11d-4ebb-842b-3952ac4303cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:16.642246 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 625/1256] 10.222.0.58 () {58 vars in 1018 bytes} [Tue Aug 23 22:29:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 22:29:16.654164 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09092ddf-8f02-4b16-a0fa-eb08e0b90cb0 None None] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:16.656271 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-09092ddf-8f02-4b16-a0fa-eb08e0b90cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:16.675124 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09092ddf-8f02-4b16-a0fa-eb08e0b90cb0 None None] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:16.683745 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abe76d-09a4-456e-add2-45b44cb76b02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55d53b8c1a4dffa00b9114d1df498a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:16.684459 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abe76d-09a4-456e-add2-45b44cb76b02 service placement] REQUEST_METHOD: `GET` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:16.685455 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abe76d-09a4-456e-add2-45b44cb76b02 service placement] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:16.685737 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abe76d-09a4-456e-add2-45b44cb76b02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:16.695793 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abe76d-09a4-456e-add2-45b44cb76b02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:16.697367 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abe76d-09a4-456e-add2-45b44cb76b02 service placement] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:16.707726 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 632/1257] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:29:16 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:29:19.955638 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a0a95-b11d-4ebb-842b-3952ac4303cd None None] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:19.957153 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-8e4a0a95-b11d-4ebb-842b-3952ac4303cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:19.973723 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a0a95-b11d-4ebb-842b-3952ac4303cd None None] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:19.978478 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:19.979272 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:19.979632 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:19.979952 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] PATH_INFO: `/v3/users/93cd01203fcf457291cc4146432580c3` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:19.995286 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93cd01203fcf457291cc4146432580c3)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:19.997733 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:20.050306 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93cd01203fcf457291cc4146432580c3'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.057321 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93cd01203fcf457291cc4146432580c3'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.057994 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93cd01203fcf457291cc4146432580c3'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.058596 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93cd01203fcf457291cc4146432580c3'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.067300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93cd01203fcf457291cc4146432580c3'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.084499 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 626/1258] 10.222.0.58 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:19 2022] DELETE /identity/v3/users/93cd01203fcf457291cc4146432580c3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:20.278059 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abe76d-09a4-456e-add2-45b44cb76b02 service placement] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:20.290386 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abe76d-09a4-456e-add2-45b44cb76b02 service placement] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:20.350144 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:20.350776 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:20.351061 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:20.351339 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] PATH_INFO: `/v3/projects/4e06ade31ecd457bbd3388109b667188` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:20.362404 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e06ade31ecd457bbd3388109b667188)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:20.364396 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:20.410730 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e06ade31ecd457bbd3388109b667188', 'request_id': 'req-f553ac94-8426-43b9-8add-55640debfa92'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.417626 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e06ade31ecd457bbd3388109b667188', 'request_id': 'req-f553ac94-8426-43b9-8add-55640debfa92'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.427133 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e06ade31ecd457bbd3388109b667188', 'request_id': 'req-f553ac94-8426-43b9-8add-55640debfa92'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.438410 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] The token cache is being invalidate because project 4e06ade31ecd457bbd3388109b667188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:20.438700 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.439348 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.440885 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 633/1259] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:20 2022] DELETE /identity/v3/projects/4e06ade31ecd457bbd3388109b667188 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:20.444880 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:20.446267 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:20.460015 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b86684-f984-4ce6-8ddf-099aff6ef858 admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:20.464535 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:20.519298 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:20.519860 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:20.520138 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:20.520411 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] PATH_INFO: `/v3/users/636b9254224842c79c2d5a7d938b505a` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:20.533861 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=636b9254224842c79c2d5a7d938b505a)` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:20.535799 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:20.584157 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636b9254224842c79c2d5a7d938b505a'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.592437 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636b9254224842c79c2d5a7d938b505a'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.593124 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636b9254224842c79c2d5a7d938b505a'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.593739 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636b9254224842c79c2d5a7d938b505a'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.601090 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.notifications [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636b9254224842c79c2d5a7d938b505a'} {{(pid=88405) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.619516 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 627/1260] 10.222.0.58 () {58 vars in 1224 bytes} [Tue Aug 23 22:29:20 2022] DELETE /identity/v3/users/636b9254224842c79c2d5a7d938b505a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:20.792855 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] Authenticating user token {{(pid=88404) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:29:20.794871 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.fernet_utils [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88404) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:29:20.807709 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553ac94-8426-43b9-8add-55640debfa92 admin admin] Validating token access rules against request {{(pid=88404) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:29:20.866797 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17015648-ce0a-45f7-b66c-95f7952d0677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88d08af5e2704454a689607c83d9c037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8dbd689839d74dba96df18fba25139c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88404) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:29:20.867725 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17015648-ce0a-45f7-b66c-95f7952d0677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:29:20.868041 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17015648-ce0a-45f7-b66c-95f7952d0677 admin admin] SCRIPT_NAME: `/identity` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:29:20.868348 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17015648-ce0a-45f7-b66c-95f7952d0677 admin admin] PATH_INFO: `/v3/projects/23ee95902763415399c1952e3cdcce04` {{(pid=88404) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:29:20.880596 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17015648-ce0a-45f7-b66c-95f7952d0677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ee95902763415399c1952e3cdcce04)` {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:29:20.882559 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17015648-ce0a-45f7-b66c-95f7952d0677 admin admin] RBAC: Authorization granted {{(pid=88404) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:29:20.883988 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:20.931677 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-17015648-ce0a-45f7-b66c-95f7952d0677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ee95902763415399c1952e3cdcce04', 'request_id': 'req-17015648-ce0a-45f7-b66c-95f7952d0677'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.939422 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-17015648-ce0a-45f7-b66c-95f7952d0677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ee95902763415399c1952e3cdcce04', 'request_id': 'req-17015648-ce0a-45f7-b66c-95f7952d0677'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.947011 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-17015648-ce0a-45f7-b66c-95f7952d0677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ee95902763415399c1952e3cdcce04', 'request_id': 'req-17015648-ce0a-45f7-b66c-95f7952d0677'} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.957528 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-17015648-ce0a-45f7-b66c-95f7952d0677 admin admin] The token cache is being invalidate because project 23ee95902763415399c1952e3cdcce04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88404) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 22:29:20.957819 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-17015648-ce0a-45f7-b66c-95f7952d0677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.958443 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG keystone.notifications [None req-17015648-ce0a-45f7-b66c-95f7952d0677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88404) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 22:29:20.959960 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: [pid: 88404|app: 0|req: 634/1261] 10.222.0.58 () {58 vars in 1233 bytes} [Tue Aug 23 22:29:20 2022] DELETE /identity/v3/projects/23ee95902763415399c1952e3cdcce04 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 22:29:30.615839 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:29:30.954480 dv-osbrick-852824-3-ceph devstack@keystone.service[88404]: DEBUG dbcounter [-] [88404] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 22:33:30.768213 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] Authenticating user token {{(pid=88405) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 22:33:30.769828 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:30.854727 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4b558-e124-451a-ba24-df18bc7e7058 admin admin] Validating token access rules against request {{(pid=88405) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 22:33:30.934268 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6ba13-fa6f-4266-86a4-73da5e64cb23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a55d53b8c1a4dffa00b9114d1df498a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d86eb186aa94e1bb4a358cfc19447b1', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88405) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 22:33:30.935000 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6ba13-fa6f-4266-86a4-73da5e64cb23 service placement] REQUEST_METHOD: `GET` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 22:33:30.936175 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6ba13-fa6f-4266-86a4-73da5e64cb23 service placement] SCRIPT_NAME: `/identity` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 22:33:30.936300 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6ba13-fa6f-4266-86a4-73da5e64cb23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88405) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 22:33:30.938161 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.fernet_utils [None req-66f6ba13-fa6f-4266-86a4-73da5e64cb23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88405) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 22:33:30.949988 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6ba13-fa6f-4266-86a4-73da5e64cb23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 22:33:30.952524 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6ba13-fa6f-4266-86a4-73da5e64cb23 service placement] RBAC: Authorization granted {{(pid=88405) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 22:33:30.965599 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: [pid: 88405|app: 0|req: 628/1262] 10.222.0.58 () {60 vars in 1365 bytes} [Tue Aug 23 22:33:30 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 22:33:40.958791 dv-osbrick-852824-3-ceph devstack@keystone.service[88405]: DEBUG dbcounter [-] [88405] Writing DB stats keystone:SELECT=62 {{(pid=88405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}